![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6680 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6675 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29264 originally caused by: Started by upstream project "master-osmo-msc" build number 34208 originally caused by: Started by upstream project "master-libsmpp34" build number 1813 originally caused by: Started by timer Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12968 originally caused by: Started by upstream project "master-openbsc" build number 13164 originally caused by: Started by upstream project "master-libsmpp34" build number 1813 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8945 originally caused by: Started by upstream project "master-osmo-mgw" build number 9177 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8700 originally caused by: Started by upstream project "master-osmo-hlr" build number 8834 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9240 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7506 originally caused by: Started by upstream project "master-osmo-bts" build number 7567 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5533 originally caused by: Started by upstream project "master-osmo-bts" build number 7567 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30041 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37191 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6675 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37192 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 Started by upstream project "master-osmo-sgsn" build number 37193 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8037 originally caused by: Started by upstream project "master-osmo-bts" build number 7567 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17655 originally caused by: Started by upstream project "master-osmo-bsc" build number 20109 originally caused by: Started by upstream project "master-osmo-mgw" build number 9177 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20110 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29265 originally caused by: Started by upstream project "master-osmo-msc" build number 34209 originally caused by: Started by upstream project "master-osmo-mgw" build number 9177 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34210 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 Started by upstream project "master-osmo-msc" build number 34211 originally caused by: Started by upstream project "master-osmo-iuh" build number 12850 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12969 originally caused by: Started by upstream project "master-openbsc" build number 13165 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4676 originally caused by: Started by upstream project "master-osmo-trx" build number 4880 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30042 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37194 originally caused by: Started by upstream project "master-osmo-iuh" build number 12850 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9110 originally caused by: Started by upstream project "master-libosmo-netif" build number 6956 originally caused by: Started by upstream project "master-libosmo-abis" build number 4953 originally caused by: Started by upstream project "master-libosmocore" build number 3067 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8946 originally caused by: Started by upstream project "master-osmo-mgw" build number 9178 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9241 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8701 originally caused by: Started by upstream project "master-osmo-hlr" build number 8835 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7507 originally caused by: Started by upstream project "master-osmo-bts" build number 7568 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 originally caused by: Started by upstream project "master-osmo-bts" build number 7568 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 originally caused by: Started by upstream project "master-osmo-bts" build number 7568 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17656 originally caused by: Started by upstream project "master-osmo-bsc" build number 20111 originally caused by: Started by upstream project "master-osmo-mgw" build number 9178 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30043 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37195 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 originally caused by: Started by upstream project "master-libosmo-abis" build number 4954 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37196 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9111 originally caused by: Started by upstream project "master-libosmo-netif" build number 6957 Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17656 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2952 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29266 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30043 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12969 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9241 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins4748333728007027106.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 02:06:58 + trial_dir_prefix=trial- + rm -rf trial-2367 trial-2367-bin.tgz trial-2367-run.tgz + trial_dir=trial-2368 + mkdir -p trial-2368 + mv open5gs.build-8.tgz osmo-bsc.build-17656.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29266.tgz osmo-nitb.build-12969.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30043.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2368 + cat open5gs.build-8.md5 osmo-bsc.build-17656.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29266.md5 osmo-nitb.build-12969.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30043.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17656.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2952.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29266.md5 osmo-nitb.build-12969.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30043.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2368 combinations: None trial: 'trial-2368' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2368 -------------------------------------------------------------------------------------------- 02:07:09.593890 tst trial-2368: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/log --------------------------------------------------------------------- trial-2368 nitb_sms:sysmo --------------------------------------------------------------------- 02:09:17.241443 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:09:17.246743 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 02:09:17.270590 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 02:09:17.277858 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 02:09:17.334745 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 02:09:17.356614 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 02:09:17.363657 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 02:09:17.901329 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:09:17.906414 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 02:09:17.917747 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 02:09:18.304141 tst mo_mt_sms.py: using LAC 25252 02:09:18.543479 tst mo_mt_sms.py: using RAC 7 02:09:18.661307 tst mo_mt_sms.py: using CellId 25252 02:09:18.780179 tst mo_mt_sms.py: using BVCI 25253 02:09:18.887884 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:09:19.071819 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:09:19.194926 tst mo_mt_sms.py:9: start nitb and bts... 02:09:19.414504 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:09:21.784395 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12250): Launched 02:09:22.111831 run osmo-nitb_10.42.42.2(pid=12251): Launched 02:09:22.290815 run osmo-nitb_10.42.42.2(pid=12251): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12251)] 02:09:22.425111 run osmo-nitb_10.42.42.2(pid=12251): stdout: | (launched: 2022-12-10_02:09:22.050962) 02:09:22.561041 run osmo-nitb_10.42.42.2(pid=12251): stderr: | (launched: 2022-12-10_02:09:22.099881) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:22.696520 run osmo-nitb_10.42.42.2(pid=12251): stdout: | (launched: 2022-12-10_02:09:22.050962) 02:09:22.825778 run osmo-nitb_10.42.42.2(pid=12251): stderr: | (launched: 2022-12-10_02:09:22.099881) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:22.980786 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12251): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12251) [trial-2368↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12251)] [trial-2368↪nitb_sms:sysmo↪mo_mt_sms.py:11] 02:09:22.989770 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 02:09:22.996682 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12250): Terminating (SIGTERM) 02:09:23.207565 --- ParallelTerminationStrategy: PID 12250 died... 02:09:23.229346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12250): Terminated: ok {rc=0} 02:09:23.318961 bus /sierra_3: Setting Powered False 02:09:24.420636 bus /sierra_3: Setting Powered False 02:09:25.540031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:sysmo --------------------------------------------------------------------- 02:09:26.724677 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:09:26.728758 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 02:09:26.749556 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 02:09:26.779347 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 02:09:26.831431 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 02:09:26.852101 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 02:09:26.879042 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 02:09:27.426271 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:09:27.431218 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:27.441918 tst sms:sysmo: Using 1 x bts (candidates: 1) 02:09:27.476346 tst mo_mt_sms.py: using LAC 25253 02:09:27.596670 tst mo_mt_sms.py: using RAC 8 02:09:27.716154 tst mo_mt_sms.py: using CellId 25253 02:09:27.836893 tst mo_mt_sms.py: using BVCI 25254 02:09:27.947436 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:27.958116 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:27.968589 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:27.979656 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:27.990610 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:09:28.001268 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:09:28.121155 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:09:28.242192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:09:29.970940 run create_hlr_db(pid=12255): Launched 02:09:30.089346 bus /sierra_2: Setting Powered False 02:09:31.154339 run create_hlr_db(pid=12255): Terminated: ok {rc=0} 02:09:31.623612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Launched 02:09:31.973306 run osmo-hlr_10.42.42.2(pid=12258): Launched 02:09:32.166043 run osmo-stp_10.42.42.5: Starting osmo-stp 02:09:34.777730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Launched 02:09:35.109969 run osmo-stp_10.42.42.5(pid=12261): Launched 02:09:35.235255 run osmo-msc_10.42.42.6: Starting osmo-msc 02:09:40.780509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Launched 02:09:41.110850 run osmo-msc_10.42.42.6(pid=12264): Launched 02:09:41.293405 run osmo-stp_10.42.42.5(pid=12261): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] 02:09:41.430131 run osmo-stp_10.42.42.5(pid=12261): stdout: | (launched: 2022-12-10_02:09:35.048297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:09:41.567700 run osmo-stp_10.42.42.5(pid=12261): stderr: | [0;m[38;5;43m20221210020935243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210020935243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210020935244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210020935244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:09:41.704858 run osmo-stp_10.42.42.5(pid=12261): stdout: | (launched: 2022-12-10_02:09:35.048297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:09:41.834616 run osmo-stp_10.42.42.5(pid=12261): stderr: | [0;m[38;5;43m20221210020935243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210020935243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210020935244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210020935244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020935245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:09:41.990010 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12261): Process ended prematurely: osmo-stp_10.42.42.5(pid=12261) [trial-2368↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] [trial-2368↪sms:sysmo↪mo_mt_sms.py:16] 02:09:41.998840 tst mo_mt_sms.py:16: Test FAILED (14.6 sec) 02:09:42.026451 run osmo-hlr_10.42.42.2(pid=12258): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12258)] 02:09:42.077631 run osmo-hlr_10.42.42.2(pid=12258): stdout: | (launched: 2022-12-10_02:09:31.911656) 02:09:42.130713 run osmo-hlr_10.42.42.2(pid=12258): stderr: | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210020932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210020932204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210020932212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020932213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020932213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:09:42.204015 run osmo-msc_10.42.42.6(pid=12264): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12264)] 02:09:42.255809 run osmo-msc_10.42.42.6(pid=12264): stdout: | (launched: 2022-12-10_02:09:41.049709) 02:09:42.308530 run osmo-msc_10.42.42.6(pid=12264): stderr: | [0;m[38;5;43m20221210020941376 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210020941376 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcd5cb97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210020941376 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210020941376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210020941376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210020941377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210020941378 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210020941379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020941379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020941379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:09:42.361680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Terminating (SIGTERM) 02:09:42.404167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Terminating (SIGTERM) 02:09:42.446848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Terminating (SIGTERM) 02:09:42.489708 --- ParallelTerminationStrategy: PID 12257 died... 02:09:42.510096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Terminated: ok {rc=0} 02:09:42.557500 --- ParallelTerminationStrategy: PID 12260 died... 02:09:42.577568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Terminated: ok {rc=0} 02:09:42.624334 --- ParallelTerminationStrategy: PID 12263 died... 02:09:42.644220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Terminated: ok {rc=0} 02:09:42.733769 bus /sierra_3: Setting Powered False 02:09:43.834502 bus /sierra_3: Setting Powered False 02:09:44.953367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:sysmo --------------------------------------------------------------------- 02:09:46.184008 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:09:46.187676 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:09:46.208661 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 02:09:46.219272 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:09:46.257065 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:09:46.285110 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 02:09:46.294010 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:09:46.814950 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 02:09:46.824121 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 02:09:46.836933 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 02:09:46.876836 tst assert_extension.py: using LAC 25254 02:09:47.033367 tst assert_extension.py: using RAC 9 02:09:47.178811 tst assert_extension.py: using CellId 25254 02:09:47.300699 tst assert_extension.py: using BVCI 25255 02:09:47.413139 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 02:09:47.534844 tst assert_extension.py:10: start nitb and bts... 02:09:47.756682 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:09:48.425584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12269): Launched 02:09:48.757759 run osmo-nitb_10.42.42.2(pid=12270): Launched 02:09:48.940631 run osmo-nitb_10.42.42.2(pid=12270): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12270)] 02:09:49.088229 run osmo-nitb_10.42.42.2(pid=12270): stdout: | (launched: 2022-12-10_02:09:48.696426) 02:09:49.238098 run osmo-nitb_10.42.42.2(pid=12270): stderr: | (launched: 2022-12-10_02:09:48.745540) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:49.386653 run osmo-nitb_10.42.42.2(pid=12270): stdout: | (launched: 2022-12-10_02:09:48.696426) 02:09:49.530045 run osmo-nitb_10.42.42.2(pid=12270): stderr: | (launched: 2022-12-10_02:09:48.745540) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12270) [trial-2368↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12270)] 02:09:49.882624 tst osmo-nitb_10.42.42.2(pid=12270): stdout: | (launched: 2022-12-10_02:09:48.696426) 02:09:50.014992 tst osmo-nitb_10.42.42.2(pid=12270): stderr: | (launched: 2022-12-10_02:09:48.745540) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:50.174699 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12270) [trial-2368↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12270)] [trial-2368↪nitb_ussd:sysmo↪assert_extension.py:12] 02:09:50.183894 tst assert_extension.py:12: Test FAILED (3.4 sec) 02:09:50.190986 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12269): Terminating (SIGTERM) 02:09:50.402211 --- ParallelTerminationStrategy: PID 12269 died... 02:09:50.424101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12269): Terminated: ok {rc=0} 02:09:50.514077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:sysmo --------------------------------------------------------------------- 02:09:51.682595 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:09:51.686943 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:09:51.708243 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 02:09:51.735087 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:09:51.770263 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:09:51.791105 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 02:09:51.818874 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:09:52.346251 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:sysmo assert_extension.py ---------------------------------------------- 02:09:52.351227 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.361890 tst ussd:sysmo: Using 1 x bts (candidates: 1) 02:09:52.398013 tst assert_extension.py: using LAC 25255 02:09:52.521372 tst assert_extension.py: using RAC 10 02:09:52.641378 tst assert_extension.py: using CellId 25255 02:09:52.761398 tst assert_extension.py: using BVCI 25256 02:09:52.872889 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.883930 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.894509 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.905710 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.916772 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:09:52.928042 tst ussd:sysmo: Using 1 x modem (candidates: 1) 02:09:53.049624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:09:53.559850 run create_hlr_db(pid=12275): Launched 02:09:53.695654 bus /sierra_2: Setting Powered False 02:09:54.759796 run create_hlr_db(pid=12275): Terminated: ok {rc=0} 02:09:55.199954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12277): Launched 02:09:55.510038 run osmo-hlr_10.42.42.2(pid=12278): Launched 02:09:55.628693 run osmo-stp_10.42.42.5: Starting osmo-stp 02:09:56.202463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12280): Launched 02:09:56.534251 run osmo-stp_10.42.42.5(pid=12281): Launched 02:09:56.660008 run osmo-msc_10.42.42.6: Starting osmo-msc 02:09:57.253014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12283): Launched 02:09:57.583881 run osmo-msc_10.42.42.6(pid=12284): Launched 02:09:57.768095 run osmo-stp_10.42.42.5(pid=12281): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12281)] 02:09:57.910115 run osmo-stp_10.42.42.5(pid=12281): stdout: | (launched: 2022-12-10_02:09:56.472594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:09:58.050407 run osmo-stp_10.42.42.5(pid=12281): stderr: | [0;m[38;5;43m20221210020956669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210020956670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210020956670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210020956670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:09:58.188496 run osmo-stp_10.42.42.5(pid=12281): stdout: | (launched: 2022-12-10_02:09:56.472594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:09:58.319358 run osmo-stp_10.42.42.5(pid=12281): stderr: | [0;m[38;5;43m20221210020956669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210020956670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210020956670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210020956670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210020956671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:09:58.475529 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12281): Process ended prematurely: osmo-stp_10.42.42.5(pid=12281) [trial-2368↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12281)] [trial-2368↪ussd:sysmo↪assert_extension.py:17] 02:09:58.484417 tst assert_extension.py:17: Test FAILED (6.1 sec) 02:09:58.511866 run osmo-hlr_10.42.42.2(pid=12278): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12278)] 02:09:58.562946 run osmo-hlr_10.42.42.2(pid=12278): stdout: | (launched: 2022-12-10_02:09:55.452340) 02:09:58.615173 run osmo-hlr_10.42.42.2(pid=12278): stderr: | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210020955631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210020955646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210020955654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210020955654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210020955654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:09:58.688397 run osmo-msc_10.42.42.6(pid=12284): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12284)] 02:09:58.739142 run osmo-msc_10.42.42.6(pid=12284): stdout: | (launched: 2022-12-10_02:09:57.522544) 02:09:58.791519 run osmo-msc_10.42.42.6(pid=12284): stderr: | [0;m[38;5;43m20221210020957845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210020957845 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f976452dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210020957845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210020957845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210020957845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210020957846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210020957847 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210020957848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210020957848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210020957848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:09:58.844231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12277): Terminating (SIGTERM) 02:09:58.886307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12280): Terminating (SIGTERM) 02:09:58.928647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12283): Terminating (SIGTERM) 02:09:58.971557 --- ParallelTerminationStrategy: PID 12277 died... 02:09:58.992152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12277): Terminated: ok {rc=0} 02:09:59.039566 --- ParallelTerminationStrategy: PID 12280 died... 02:09:59.059744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12280): Terminated: ok {rc=0} 02:09:59.107216 --- ParallelTerminationStrategy: PID 12283 died... 02:09:59.127229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12283): Terminated: ok {rc=0} 02:09:59.217164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:10:00.450535 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:00.457612 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:10:00.479822 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:10:00.507288 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:10:00.559541 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:10:00.580853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:10:00.608654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:10:01.185526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:10:01.248715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:01.263849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:10:01.337067 tst mo_mt_call.py: using LAC 25256 02:10:01.469114 tst mo_mt_call.py: using RAC 11 02:10:01.609402 tst mo_mt_call.py: using CellId 25256 02:10:01.767259 tst mo_mt_call.py: using BVCI 25257 02:10:01.925532 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:01.940824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:01.957055 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:01.972264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:01.988273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:02.003972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:02.132613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:02.275038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:02.774318 run create_hlr_db(pid=12292): Launched 02:10:02.895023 bus /sierra_2: Setting Powered False 02:10:03.957088 run create_hlr_db(pid=12292): Terminated: ok {rc=0} 02:10:04.414670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12294): Launched 02:10:04.751524 run osmo-hlr_10.42.42.2(pid=12295): Launched 02:10:04.878697 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:05.455994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Launched 02:10:05.814492 run osmo-stp_10.42.42.5(pid=12298): Launched 02:10:05.941797 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:06.546912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12300): Launched 02:10:06.882478 run osmo-msc_10.42.42.6(pid=12301): Launched 02:10:07.069111 run osmo-stp_10.42.42.5(pid=12298): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12298)] 02:10:07.210562 run osmo-stp_10.42.42.5(pid=12298): stdout: | (launched: 2022-12-10_02:10:05.752424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:07.352205 run osmo-stp_10.42.42.5(pid=12298): stderr: | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021005950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:07.492189 run osmo-stp_10.42.42.5(pid=12298): stdout: | (launched: 2022-12-10_02:10:05.752424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:07.624619 run osmo-stp_10.42.42.5(pid=12298): stderr: | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021005950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021005950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021005951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:07.783528 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12298): Process ended prematurely: osmo-stp_10.42.42.5(pid=12298) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12298)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:10:07.793036 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 02:10:07.820999 run osmo-hlr_10.42.42.2(pid=12295): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12295)] 02:10:07.871785 run osmo-hlr_10.42.42.2(pid=12295): stdout: | (launched: 2022-12-10_02:10:04.689071) 02:10:07.924474 run osmo-hlr_10.42.42.2(pid=12295): stderr: | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021004893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021004908 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021004918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021004918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021004918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:07.997615 run osmo-msc_10.42.42.6(pid=12301): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12301)] 02:10:08.048534 run osmo-msc_10.42.42.6(pid=12301): stdout: | (launched: 2022-12-10_02:10:06.820167) 02:10:08.101179 run osmo-msc_10.42.42.6(pid=12301): stderr: | [0;m[38;5;43m20221210021007145 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021007145 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba4d49ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021007145 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021007145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021007145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021007146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021007149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021007150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021007150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021007150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:08.154478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12294): Terminating (SIGTERM) 02:10:08.196848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Terminating (SIGTERM) 02:10:08.239354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12300): Terminating (SIGTERM) 02:10:08.282145 --- ParallelTerminationStrategy: PID 12294 died... 02:10:08.302481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12294): Terminated: ok {rc=0} 02:10:08.349378 --- ParallelTerminationStrategy: PID 12297 died... 02:10:08.369083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Terminated: ok {rc=0} 02:10:08.415575 --- ParallelTerminationStrategy: PID 12300 died... 02:10:08.435301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12300): Terminated: ok {rc=0} 02:10:08.524044 bus /sierra_3: Setting Powered False 02:10:09.625030 bus /sierra_3: Setting Powered False 02:10:10.742680 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:10:11.895846 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:11.908231 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:10:11.971693 tst mo_mt_call_osmux.py: using LAC 25257 02:10:12.102721 tst mo_mt_call_osmux.py: using RAC 12 02:10:12.234906 tst mo_mt_call_osmux.py: using CellId 25257 02:10:12.366434 tst mo_mt_call_osmux.py: using BVCI 25258 02:10:12.490261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:12.502276 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:12.513815 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:12.525740 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:12.537435 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:12.549616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:12.671380 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:12.790374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:13.278560 run create_hlr_db(pid=12303): Launched 02:10:13.400506 bus /sierra_2: Setting Powered False 02:10:14.462858 run create_hlr_db(pid=12303): Terminated: ok {rc=0} 02:10:14.899697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12305): Launched 02:10:15.215320 run osmo-hlr_10.42.42.2(pid=12306): Launched 02:10:15.337451 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:15.893796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12308): Launched 02:10:16.228110 run osmo-stp_10.42.42.5(pid=12309): Launched 02:10:16.446408 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:17.250657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12311): Launched 02:10:17.569115 run osmo-msc_10.42.42.6(pid=12312): Launched 02:10:17.745803 run osmo-stp_10.42.42.5(pid=12309): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12309)] 02:10:17.883093 run osmo-stp_10.42.42.5(pid=12309): stdout: | (launched: 2022-12-10_02:10:16.168259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:18.015766 run osmo-stp_10.42.42.5(pid=12309): stderr: | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021016512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:18.147140 run osmo-stp_10.42.42.5(pid=12309): stdout: | (launched: 2022-12-10_02:10:16.168259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:18.271197 run osmo-stp_10.42.42.5(pid=12309): stderr: | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021016511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021016512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021016512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:18.419762 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12309): Process ended prematurely: osmo-stp_10.42.42.5(pid=12309) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12309)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:10:18.428755 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 02:10:18.455913 run osmo-hlr_10.42.42.2(pid=12306): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12306)] 02:10:18.505129 run osmo-hlr_10.42.42.2(pid=12306): stdout: | (launched: 2022-12-10_02:10:15.156764) 02:10:18.555541 run osmo-hlr_10.42.42.2(pid=12306): stderr: | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021015336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021015367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021015378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021015378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021015378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:18.625502 run osmo-msc_10.42.42.6(pid=12312): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12312)] 02:10:18.674333 run osmo-msc_10.42.42.6(pid=12312): stdout: | (launched: 2022-12-10_02:10:17.510380) 02:10:18.724797 run osmo-msc_10.42.42.6(pid=12312): stderr: | [0;m[38;5;43m20221210021017782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021017783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0fb7d01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021017783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021017783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021017783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021017783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021017785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021017785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021017786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021017786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:18.775549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12305): Terminating (SIGTERM) 02:10:18.816214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12308): Terminating (SIGTERM) 02:10:18.857266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12311): Terminating (SIGTERM) 02:10:18.898024 --- ParallelTerminationStrategy: PID 12305 died... 02:10:18.917410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12305): Terminated: ok {rc=0} 02:10:18.962554 --- ParallelTerminationStrategy: PID 12308 died... 02:10:18.981687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12308): Terminated: ok {rc=0} 02:10:19.026587 --- ParallelTerminationStrategy: PID 12311 died... 02:10:19.045634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12311): Terminated: ok {rc=0} 02:10:19.131171 bus /sierra_3: Setting Powered False 02:10:20.229796 bus /sierra_3: Setting Powered False 02:10:21.350685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:10:22.586743 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:22.593103 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:10:22.614241 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:10:22.641490 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:10:22.694014 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:10:22.714597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:10:22.741070 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:10:23.297793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:10:23.348471 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.359680 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:10:23.416630 tst mo_mt_call.py: using LAC 25258 02:10:23.541297 tst mo_mt_call.py: using RAC 13 02:10:23.665602 tst mo_mt_call.py: using CellId 25258 02:10:23.797697 tst mo_mt_call.py: using BVCI 25259 02:10:23.920715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.932536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.944113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.955726 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.967351 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:23.978829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:24.097948 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:24.217304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:24.704632 run create_hlr_db(pid=12317): Launched 02:10:24.827512 bus /sierra_2: Setting Powered False 02:10:25.888821 run create_hlr_db(pid=12317): Terminated: ok {rc=0} 02:10:26.347440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12319): Launched 02:10:26.683889 run osmo-hlr_10.42.42.2(pid=12320): Launched 02:10:26.813401 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:27.392527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12322): Launched 02:10:27.729727 run osmo-stp_10.42.42.5(pid=12323): Launched 02:10:27.857272 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:28.464477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12325): Launched 02:10:28.801177 run osmo-msc_10.42.42.6(pid=12326): Launched 02:10:28.988526 run osmo-stp_10.42.42.5(pid=12323): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12323)] 02:10:29.129299 run osmo-stp_10.42.42.5(pid=12323): stdout: | (launched: 2022-12-10_02:10:27.667510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:29.271171 run osmo-stp_10.42.42.5(pid=12323): stderr: | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021027866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:29.411082 run osmo-stp_10.42.42.5(pid=12323): stdout: | (launched: 2022-12-10_02:10:27.667510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:29.543424 run osmo-stp_10.42.42.5(pid=12323): stderr: | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021027865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021027866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021027866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:29.701864 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12323): Process ended prematurely: osmo-stp_10.42.42.5(pid=12323) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12323)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:10:29.711518 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:10:29.739577 run osmo-hlr_10.42.42.2(pid=12320): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12320)] 02:10:29.789930 run osmo-hlr_10.42.42.2(pid=12320): stdout: | (launched: 2022-12-10_02:10:26.622064) 02:10:29.842282 run osmo-hlr_10.42.42.2(pid=12320): stderr: | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021026822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021026834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021026843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021026843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021026843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:29.914558 run osmo-msc_10.42.42.6(pid=12326): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12326)] 02:10:29.964801 run osmo-msc_10.42.42.6(pid=12326): stdout: | (launched: 2022-12-10_02:10:28.739074) 02:10:30.017252 run osmo-msc_10.42.42.6(pid=12326): stderr: | [0;m[38;5;43m20221210021029065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021029065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4554a8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021029065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021029065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021029065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021029066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021029069 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021029069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021029070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021029070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:30.069472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12319): Terminating (SIGTERM) 02:10:30.111341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12322): Terminating (SIGTERM) 02:10:30.153731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12325): Terminating (SIGTERM) 02:10:30.196026 --- ParallelTerminationStrategy: PID 12319 died... 02:10:30.216369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12319): Terminated: ok {rc=0} 02:10:30.263233 --- ParallelTerminationStrategy: PID 12322 died... 02:10:30.282991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12322): Terminated: ok {rc=0} 02:10:30.329580 --- ParallelTerminationStrategy: PID 12325 died... 02:10:30.349492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12325): Terminated: ok {rc=0} 02:10:30.437508 bus /sierra_3: Setting Powered False 02:10:31.546195 bus /sierra_3: Setting Powered False 02:10:32.679760 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:10:33.834463 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:33.846933 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:10:33.908203 tst mo_mt_call_osmux.py: using LAC 25259 02:10:34.038889 tst mo_mt_call_osmux.py: using RAC 14 02:10:34.168899 tst mo_mt_call_osmux.py: using CellId 25259 02:10:34.298341 tst mo_mt_call_osmux.py: using BVCI 25260 02:10:34.420229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:34.432015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:34.443510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:34.454996 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:34.466960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:34.478721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:34.599093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:34.721801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:35.243388 run create_hlr_db(pid=12328): Launched 02:10:35.378694 bus /sierra_2: Setting Powered False 02:10:36.444264 run create_hlr_db(pid=12328): Terminated: ok {rc=0} 02:10:36.891157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Launched 02:10:37.207742 run osmo-hlr_10.42.42.2(pid=12331): Launched 02:10:37.326974 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:37.882471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Launched 02:10:38.199049 run osmo-stp_10.42.42.5(pid=12334): Launched 02:10:38.321319 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:38.889744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Launched 02:10:39.207766 run osmo-msc_10.42.42.6(pid=12337): Launched 02:10:39.385625 run osmo-stp_10.42.42.5(pid=12334): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] 02:10:39.518517 run osmo-stp_10.42.42.5(pid=12334): stdout: | (launched: 2022-12-10_02:10:38.140273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:39.651034 run osmo-stp_10.42.42.5(pid=12334): stderr: | [0;m[38;5;43m20221210021038311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021038311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021038312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021038312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:39.781678 run osmo-stp_10.42.42.5(pid=12334): stdout: | (launched: 2022-12-10_02:10:38.140273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:39.906130 run osmo-stp_10.42.42.5(pid=12334): stderr: | [0;m[38;5;43m20221210021038311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021038311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021038312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021038312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021038314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:40.054596 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12334): Process ended prematurely: osmo-stp_10.42.42.5(pid=12334) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:10:40.063610 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:10:40.090721 run osmo-hlr_10.42.42.2(pid=12331): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12331)] 02:10:40.139204 run osmo-hlr_10.42.42.2(pid=12331): stdout: | (launched: 2022-12-10_02:10:37.149187) 02:10:40.189720 run osmo-hlr_10.42.42.2(pid=12331): stderr: | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021037327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021037342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021037353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021037353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021037353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:40.259420 run osmo-msc_10.42.42.6(pid=12337): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12337)] 02:10:40.307878 run osmo-msc_10.42.42.6(pid=12337): stdout: | (launched: 2022-12-10_02:10:39.148869) 02:10:40.358105 run osmo-msc_10.42.42.6(pid=12337): stderr: | [0;m[38;5;43m20221210021039425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021039425 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc94096c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021039426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021039426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021039426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021039426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021039428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021039428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021039428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021039428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:40.408767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Terminating (SIGTERM) 02:10:40.449147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Terminating (SIGTERM) 02:10:40.489342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Terminating (SIGTERM) 02:10:40.529777 --- ParallelTerminationStrategy: PID 12330 died... 02:10:40.548890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Terminated: ok {rc=0} 02:10:40.594115 --- ParallelTerminationStrategy: PID 12333 died... 02:10:40.612831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Terminated: ok {rc=0} 02:10:40.657600 --- ParallelTerminationStrategy: PID 12336 died... 02:10:40.676776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Terminated: ok {rc=0} 02:10:40.762051 bus /sierra_3: Setting Powered False 02:10:41.861080 bus /sierra_3: Setting Powered False 02:10:42.979910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:10:44.218113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:44.225783 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:10:44.247376 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:10:44.275206 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:10:44.328700 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:10:44.350416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:10:44.377853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:10:44.928154 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:10:44.979312 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:44.990673 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:10:45.050290 tst mo_mt_call.py: using LAC 25260 02:10:45.173899 tst mo_mt_call.py: using RAC 15 02:10:45.305255 tst mo_mt_call.py: using CellId 25260 02:10:45.434190 tst mo_mt_call.py: using BVCI 25261 02:10:45.557510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:45.569711 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:45.581169 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:45.592733 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:45.604251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:45.615879 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:10:45.736364 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:10:45.872466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:46.387115 run create_hlr_db(pid=12342): Launched 02:10:46.568763 bus /sierra_2: Setting Powered False 02:10:47.630817 run create_hlr_db(pid=12342): Terminated: ok {rc=0} 02:10:48.088021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12344): Launched 02:10:48.425654 run osmo-hlr_10.42.42.2(pid=12345): Launched 02:10:48.552866 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:49.135398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12347): Launched 02:10:49.471060 run osmo-stp_10.42.42.5(pid=12348): Launched 02:10:49.599385 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:50.204549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12350): Launched 02:10:50.542110 run osmo-msc_10.42.42.6(pid=12351): Launched 02:10:50.727963 run osmo-stp_10.42.42.5(pid=12348): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12348)] 02:10:50.868236 run osmo-stp_10.42.42.5(pid=12348): stdout: | (launched: 2022-12-10_02:10:49.408809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:51.009497 run osmo-stp_10.42.42.5(pid=12348): stderr: | [0;m[38;5;43m20221210021049606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021049607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021049607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021049607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:51.151188 run osmo-stp_10.42.42.5(pid=12348): stdout: | (launched: 2022-12-10_02:10:49.408809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:51.284004 run osmo-stp_10.42.42.5(pid=12348): stderr: | [0;m[38;5;43m20221210021049606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021049607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021049607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021049607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021049608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:51.442855 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12348): Process ended prematurely: osmo-stp_10.42.42.5(pid=12348) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12348)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:10:51.452422 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:10:51.480663 run osmo-hlr_10.42.42.2(pid=12345): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12345)] 02:10:51.531585 run osmo-hlr_10.42.42.2(pid=12345): stdout: | (launched: 2022-12-10_02:10:48.363618) 02:10:51.584297 run osmo-hlr_10.42.42.2(pid=12345): stderr: | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021048567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021048581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021048591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021048591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021048591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:51.657569 run osmo-msc_10.42.42.6(pid=12351): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12351)] 02:10:51.708359 run osmo-msc_10.42.42.6(pid=12351): stdout: | (launched: 2022-12-10_02:10:50.479624) 02:10:51.760534 run osmo-msc_10.42.42.6(pid=12351): stderr: | [0;m[38;5;43m20221210021050806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021050807 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17ff41fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021050807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021050807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021050807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021050807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021050809 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021050809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021050809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021050810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:51.813443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12344): Terminating (SIGTERM) 02:10:51.855517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12347): Terminating (SIGTERM) 02:10:51.897801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12350): Terminating (SIGTERM) 02:10:51.940300 --- ParallelTerminationStrategy: PID 12344 died... 02:10:51.960592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12344): Terminated: ok {rc=0} 02:10:52.007723 --- ParallelTerminationStrategy: PID 12347 died... 02:10:52.027459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12347): Terminated: ok {rc=0} 02:10:52.074695 --- ParallelTerminationStrategy: PID 12350 died... 02:10:52.095558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12350): Terminated: ok {rc=0} 02:10:52.185615 bus /sierra_3: Setting Powered False 02:10:53.286253 bus /sierra_3: Setting Powered False 02:10:54.404085 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:10:55.557666 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:55.570113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:10:55.628725 tst mo_mt_call_osmux.py: using LAC 25261 02:10:55.761389 tst mo_mt_call_osmux.py: using RAC 16 02:10:55.894793 tst mo_mt_call_osmux.py: using CellId 25261 02:10:56.028887 tst mo_mt_call_osmux.py: using BVCI 25262 02:10:56.152345 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:56.164152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:56.175667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:56.187191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:56.198645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:10:56.210134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:10:56.331233 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:10:56.451262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:56.940356 run create_hlr_db(pid=12353): Launched 02:10:57.063004 bus /sierra_2: Setting Powered False 02:10:58.125110 run create_hlr_db(pid=12353): Terminated: ok {rc=0} 02:10:58.573155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Launched 02:10:58.889970 run osmo-hlr_10.42.42.2(pid=12356): Launched 02:10:59.011357 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:59.564711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Launched 02:10:59.880137 run osmo-stp_10.42.42.5(pid=12359): Launched 02:11:00.000544 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:00.568053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Launched 02:11:00.913692 run osmo-msc_10.42.42.6(pid=12362): Launched 02:11:01.355795 run osmo-stp_10.42.42.5(pid=12359): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] 02:11:01.538484 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-10_02:10:59.821637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:01.683244 run osmo-stp_10.42.42.5(pid=12359): stderr: | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021059999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:01.817651 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-10_02:10:59.821637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:01.946202 run osmo-stp_10.42.42.5(pid=12359): stderr: | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021059998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021059999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021059999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:02.098535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:11:02.107814 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 02:11:02.136749 run osmo-hlr_10.42.42.2(pid=12356): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12356)] 02:11:02.188009 run osmo-hlr_10.42.42.2(pid=12356): stdout: | (launched: 2022-12-10_02:10:58.831079) 02:11:02.240619 run osmo-hlr_10.42.42.2(pid=12356): stderr: | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021059014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021059026 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021059035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021059035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021059035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:02.313922 run osmo-msc_10.42.42.6(pid=12362): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12362)] 02:11:02.362949 run osmo-msc_10.42.42.6(pid=12362): stdout: | (launched: 2022-12-10_02:11:00.825536) 02:11:02.413602 run osmo-msc_10.42.42.6(pid=12362): stderr: | [0;m[38;5;43m20221210021101223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021101224 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d25391c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021101224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021101224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021101224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021101224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021101226 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021101226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021101227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021101227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:02.464601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminating (SIGTERM) 02:11:02.505121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminating (SIGTERM) 02:11:02.545721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminating (SIGTERM) 02:11:02.586729 --- ParallelTerminationStrategy: PID 12355 died... 02:11:02.606215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminated: ok {rc=0} 02:11:02.651389 --- ParallelTerminationStrategy: PID 12358 died... 02:11:02.670346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminated: ok {rc=0} 02:11:02.715692 --- ParallelTerminationStrategy: PID 12361 died... 02:11:02.734573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminated: ok {rc=0} 02:11:02.822328 bus /sierra_3: Setting Powered False 02:11:03.923845 bus /sierra_3: Setting Powered False 02:11:05.038570 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:11:06.281784 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:06.288844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:11:06.310886 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:11:06.338722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:11:06.393368 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:11:06.414908 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:11:06.442489 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:11:06.994034 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:11:07.047746 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.059491 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:11:07.117159 tst mo_mt_call.py: using LAC 25262 02:11:07.248660 tst mo_mt_call.py: using RAC 17 02:11:07.379431 tst mo_mt_call.py: using CellId 25262 02:11:07.511631 tst mo_mt_call.py: using BVCI 25263 02:11:07.633978 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.645618 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.657050 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.669228 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.680814 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:07.692496 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:07.813342 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:07.934609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:08.456071 run create_hlr_db(pid=12367): Launched 02:11:08.593963 bus /sierra_2: Setting Powered False 02:11:09.659652 run create_hlr_db(pid=12367): Terminated: ok {rc=0} 02:11:10.107343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Launched 02:11:10.423013 run osmo-hlr_10.42.42.2(pid=12370): Launched 02:11:10.542190 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:11.096786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Launched 02:11:11.413983 run osmo-stp_10.42.42.5(pid=12373): Launched 02:11:11.535117 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:12.100766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Launched 02:11:12.416046 run osmo-msc_10.42.42.6(pid=12376): Launched 02:11:12.594310 run osmo-stp_10.42.42.5(pid=12373): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] 02:11:12.726911 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-10_02:11:11.355082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:12.859975 run osmo-stp_10.42.42.5(pid=12373): stderr: | [0;m[38;5;43m20221210021111529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021111529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021111530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021111530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021111530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021111531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021111531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:12.991650 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-10_02:11:11.355082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:13.115894 run osmo-stp_10.42.42.5(pid=12373): stderr: | [0;m[38;5;43m20221210021111529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021111529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021111530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021111530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021111530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021111531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021111531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:13.265147 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:11:13.274113 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:11:13.301208 run osmo-hlr_10.42.42.2(pid=12370): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12370)] 02:11:13.349652 run osmo-hlr_10.42.42.2(pid=12370): stdout: | (launched: 2022-12-10_02:11:10.364586) 02:11:13.399916 run osmo-hlr_10.42.42.2(pid=12370): stderr: | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021110543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021110556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021110564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021110565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021110565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:13.469756 run osmo-msc_10.42.42.6(pid=12376): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12376)] 02:11:13.518144 run osmo-msc_10.42.42.6(pid=12376): stdout: | (launched: 2022-12-10_02:11:12.357134) 02:11:13.568253 run osmo-msc_10.42.42.6(pid=12376): stderr: | [0;m[38;5;43m20221210021112633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021112634 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0668326c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021112634 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021112634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021112634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021112634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021112636 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021112636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021112636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021112636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:13.618729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminating (SIGTERM) 02:11:13.659041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminating (SIGTERM) 02:11:13.699376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Terminating (SIGTERM) 02:11:13.740123 --- ParallelTerminationStrategy: PID 12369 died... 02:11:13.759220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminated: ok {rc=0} 02:11:13.804064 --- ParallelTerminationStrategy: PID 12372 died... 02:11:13.822828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminated: ok {rc=0} 02:11:13.867870 --- ParallelTerminationStrategy: PID 12375 died... 02:11:13.886757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Terminated: ok {rc=0} 02:11:13.974212 bus /sierra_3: Setting Powered False 02:11:15.075585 bus /sierra_3: Setting Powered False 02:11:16.210584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:11:17.374345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:17.386865 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:11:17.445418 tst mo_mt_call_osmux.py: using LAC 25263 02:11:17.580607 tst mo_mt_call_osmux.py: using RAC 18 02:11:17.712639 tst mo_mt_call_osmux.py: using CellId 25263 02:11:17.842363 tst mo_mt_call_osmux.py: using BVCI 25264 02:11:17.966348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:17.977943 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:17.989387 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:18.000651 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:18.012170 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:18.023607 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:18.147243 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:18.271210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:18.792216 run create_hlr_db(pid=12378): Launched 02:11:18.929594 bus /sierra_2: Setting Powered False 02:11:19.995511 run create_hlr_db(pid=12378): Terminated: ok {rc=0} 02:11:20.443398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12380): Launched 02:11:20.760092 run osmo-hlr_10.42.42.2(pid=12381): Launched 02:11:20.879505 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:21.437621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12383): Launched 02:11:21.754494 run osmo-stp_10.42.42.5(pid=12384): Launched 02:11:21.875792 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:22.482274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12386): Launched 02:11:22.798694 run osmo-msc_10.42.42.6(pid=12387): Launched 02:11:22.973630 run osmo-stp_10.42.42.5(pid=12384): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12384)] 02:11:23.107092 run osmo-stp_10.42.42.5(pid=12384): stdout: | (launched: 2022-12-10_02:11:21.695499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:23.240153 run osmo-stp_10.42.42.5(pid=12384): stderr: | [0;m[38;5;43m20221210021121869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021121870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021121870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021121870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:23.371235 run osmo-stp_10.42.42.5(pid=12384): stdout: | (launched: 2022-12-10_02:11:21.695499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:23.495464 run osmo-stp_10.42.42.5(pid=12384): stderr: | [0;m[38;5;43m20221210021121869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021121870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021121870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021121870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021121871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:23.643972 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12384): Process ended prematurely: osmo-stp_10.42.42.5(pid=12384) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12384)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:11:23.653120 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:11:23.679915 run osmo-hlr_10.42.42.2(pid=12381): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12381)] 02:11:23.728184 run osmo-hlr_10.42.42.2(pid=12381): stdout: | (launched: 2022-12-10_02:11:20.701432) 02:11:23.778182 run osmo-hlr_10.42.42.2(pid=12381): stderr: | [0;m[1;31m20221210021120881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021120881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021120881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021120881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021120882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021120882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021120894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021120902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021120903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021120903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:23.847706 run osmo-msc_10.42.42.6(pid=12387): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12387)] 02:11:23.896121 run osmo-msc_10.42.42.6(pid=12387): stdout: | (launched: 2022-12-10_02:11:22.739504) 02:11:23.946280 run osmo-msc_10.42.42.6(pid=12387): stderr: | [0;m[38;5;43m20221210021123016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021123016 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc36568c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021123017 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021123017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021123017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021123017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021123019 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021123019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021123019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021123019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:23.996512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12380): Terminating (SIGTERM) 02:11:24.036378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12383): Terminating (SIGTERM) 02:11:24.076255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12386): Terminating (SIGTERM) 02:11:24.116504 --- ParallelTerminationStrategy: PID 12380 died... 02:11:24.135862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12380): Terminated: ok {rc=0} 02:11:24.180383 --- ParallelTerminationStrategy: PID 12383 died... 02:11:24.199399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12383): Terminated: ok {rc=0} 02:11:24.243848 --- ParallelTerminationStrategy: PID 12386 died... 02:11:24.262536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12386): Terminated: ok {rc=0} 02:11:24.349118 bus /sierra_3: Setting Powered False 02:11:25.449610 bus /sierra_3: Setting Powered False 02:11:26.564419 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:11:27.804029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:27.811619 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:11:27.833466 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:11:27.860447 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:11:27.912113 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:11:27.936496 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:11:27.965550 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:11:28.510863 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:11:28.561990 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:28.573122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:11:28.629413 tst mo_mt_call.py: using LAC 25264 02:11:28.753147 tst mo_mt_call.py: using RAC 19 02:11:28.877710 tst mo_mt_call.py: using CellId 25264 02:11:29.013729 tst mo_mt_call.py: using BVCI 25265 02:11:29.136802 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:29.149095 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:29.160740 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:29.172713 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:29.184547 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:29.196496 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:11:29.314088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:11:29.435266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:29.958122 run create_hlr_db(pid=12393): Launched 02:11:30.095851 bus /sierra_2: Setting Powered False 02:11:31.162106 run create_hlr_db(pid=12393): Terminated: ok {rc=0} 02:11:31.661624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Launched 02:11:32.017299 run osmo-hlr_10.42.42.2(pid=12396): Launched 02:11:32.242405 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:32.789696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Launched 02:11:33.106364 run osmo-stp_10.42.42.5(pid=12399): Launched 02:11:33.228444 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:33.795997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12401): Launched 02:11:34.111780 run osmo-msc_10.42.42.6(pid=12402): Launched 02:11:34.288518 run osmo-stp_10.42.42.5(pid=12399): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] 02:11:34.421874 run osmo-stp_10.42.42.5(pid=12399): stdout: | (launched: 2022-12-10_02:11:33.047191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:34.555101 run osmo-stp_10.42.42.5(pid=12399): stderr: | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021133221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:34.686546 run osmo-stp_10.42.42.5(pid=12399): stdout: | (launched: 2022-12-10_02:11:33.047191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:34.810824 run osmo-stp_10.42.42.5(pid=12399): stderr: | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021133220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021133221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021133223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:34.960057 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12399): Process ended prematurely: osmo-stp_10.42.42.5(pid=12399) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:11:34.968940 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:11:34.996142 run osmo-hlr_10.42.42.2(pid=12396): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12396)] 02:11:35.044884 run osmo-hlr_10.42.42.2(pid=12396): stdout: | (launched: 2022-12-10_02:11:31.952873) 02:11:35.095230 run osmo-hlr_10.42.42.2(pid=12396): stderr: | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021132307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021132321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021132329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021132329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021132329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:35.165559 run osmo-msc_10.42.42.6(pid=12402): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12402)] 02:11:35.214180 run osmo-msc_10.42.42.6(pid=12402): stdout: | (launched: 2022-12-10_02:11:34.052378) 02:11:35.264572 run osmo-msc_10.42.42.6(pid=12402): stderr: | [0;m[38;5;43m20221210021134325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021134326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f823e58dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021134326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021134326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021134326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021134326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021134328 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021134328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:35.315182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Terminating (SIGTERM) 02:11:35.356008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Terminating (SIGTERM) 02:11:35.396886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12401): Terminating (SIGTERM) 02:11:35.438586 --- ParallelTerminationStrategy: PID 12395 died... 02:11:35.458029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12395): Terminated: ok {rc=0} 02:11:35.503525 --- ParallelTerminationStrategy: PID 12398 died... 02:11:35.522613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12398): Terminated: ok {rc=0} 02:11:35.567676 --- ParallelTerminationStrategy: PID 12401 died... 02:11:35.586587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12401): Terminated: ok {rc=0} 02:11:35.674321 bus /sierra_3: Setting Powered False 02:11:36.776092 bus /sierra_3: Setting Powered False 02:11:37.894575 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:11:39.044413 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.056334 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:11:39.111965 tst mo_mt_call_osmux.py: using LAC 25265 02:11:39.236396 tst mo_mt_call_osmux.py: using RAC 20 02:11:39.357642 tst mo_mt_call_osmux.py: using CellId 25265 02:11:39.488476 tst mo_mt_call_osmux.py: using BVCI 25266 02:11:39.610822 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.622777 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.634471 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.646277 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.658396 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:11:39.670263 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:11:39.790102 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:11:39.912461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:40.399740 run create_hlr_db(pid=12404): Launched 02:11:40.522566 bus /sierra_2: Setting Powered False 02:11:41.584563 run create_hlr_db(pid=12404): Terminated: ok {rc=0} 02:11:42.020223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Launched 02:11:42.335939 run osmo-hlr_10.42.42.2(pid=12407): Launched 02:11:42.455325 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:43.007122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Launched 02:11:43.322615 run osmo-stp_10.42.42.5(pid=12410): Launched 02:11:43.443518 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:44.010799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12412): Launched 02:11:44.327854 run osmo-msc_10.42.42.6(pid=12413): Launched 02:11:44.504701 run osmo-stp_10.42.42.5(pid=12410): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] 02:11:44.639055 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-10_02:11:43.263679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:44.772383 run osmo-stp_10.42.42.5(pid=12410): stderr: | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021143435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:44.903083 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-10_02:11:43.263679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:45.027256 run osmo-stp_10.42.42.5(pid=12410): stderr: | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021143435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021143435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021143438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:45.176020 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:11:45.185090 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:11:45.211897 run osmo-hlr_10.42.42.2(pid=12407): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12407)] 02:11:45.260289 run osmo-hlr_10.42.42.2(pid=12407): stdout: | (launched: 2022-12-10_02:11:42.277454) 02:11:45.310240 run osmo-hlr_10.42.42.2(pid=12407): stderr: | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021142456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021142468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021142477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021142477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021142477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:45.380053 run osmo-msc_10.42.42.6(pid=12413): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12413)] 02:11:45.428434 run osmo-msc_10.42.42.6(pid=12413): stdout: | (launched: 2022-12-10_02:11:44.268856) 02:11:45.478625 run osmo-msc_10.42.42.6(pid=12413): stderr: | [0;m[38;5;43m20221210021144542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021144542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6b2431c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021144542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021144543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021144543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021144543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021144545 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021144545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021144545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021144545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:45.529224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminating (SIGTERM) 02:11:45.569383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminating (SIGTERM) 02:11:45.609647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12412): Terminating (SIGTERM) 02:11:45.650063 --- ParallelTerminationStrategy: PID 12406 died... 02:11:45.669255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminated: ok {rc=0} 02:11:45.713906 --- ParallelTerminationStrategy: PID 12409 died... 02:11:45.732654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminated: ok {rc=0} 02:11:45.777240 --- ParallelTerminationStrategy: PID 12412 died... 02:11:45.795872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12412): Terminated: ok {rc=0} 02:11:45.886904 bus /sierra_3: Setting Powered False 02:11:46.985606 bus /sierra_3: Setting Powered False 02:11:48.099521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:11:49.340403 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:49.347756 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:11:49.370027 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:11:49.398033 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:11:49.451501 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:11:49.473218 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:11:49.500883 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:11:50.053741 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:11:50.107632 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.119393 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:11:50.181604 tst mo_mt_call.py: using LAC 25266 02:11:50.311530 tst mo_mt_call.py: using RAC 21 02:11:50.441192 tst mo_mt_call.py: using CellId 25266 02:11:50.570335 tst mo_mt_call.py: using BVCI 25267 02:11:50.693499 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.705175 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.716579 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.728217 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.739855 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:11:50.751570 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:11:50.872715 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:11:50.995870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:51.517719 run create_hlr_db(pid=12418): Launched 02:11:51.655800 bus /sierra_2: Setting Powered False 02:11:52.722362 run create_hlr_db(pid=12418): Terminated: ok {rc=0} 02:11:53.190132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Launched 02:11:53.528909 run osmo-hlr_10.42.42.2(pid=12421): Launched 02:11:53.658906 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:54.238086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Launched 02:11:54.575005 run osmo-stp_10.42.42.5(pid=12424): Launched 02:11:54.702771 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:55.310305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Launched 02:11:55.648669 run osmo-msc_10.42.42.6(pid=12427): Launched 02:11:55.835313 run osmo-stp_10.42.42.5(pid=12424): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] 02:11:55.976269 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-10_02:11:54.512485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:56.118101 run osmo-stp_10.42.42.5(pid=12424): stderr: | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021154710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:56.259326 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-10_02:11:54.512485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:56.392807 run osmo-stp_10.42.42.5(pid=12424): stderr: | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021154709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021154710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021154710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:56.552387 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:11:56.562294 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:11:56.590620 run osmo-hlr_10.42.42.2(pid=12421): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12421)] 02:11:56.641573 run osmo-hlr_10.42.42.2(pid=12421): stdout: | (launched: 2022-12-10_02:11:53.466471) 02:11:56.694313 run osmo-hlr_10.42.42.2(pid=12421): stderr: | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021153671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021153685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021153693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021153694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021153694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:56.767350 run osmo-msc_10.42.42.6(pid=12427): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12427)] 02:11:56.818238 run osmo-msc_10.42.42.6(pid=12427): stdout: | (launched: 2022-12-10_02:11:55.584876) 02:11:56.870812 run osmo-msc_10.42.42.6(pid=12427): stderr: | [0;m[38;5;43m20221210021155912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021155912 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb4e691dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021155912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021155912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021155912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021155912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021155914 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021155914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021155915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021155915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:56.923543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminating (SIGTERM) 02:11:56.965975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminating (SIGTERM) 02:11:57.008466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Terminating (SIGTERM) 02:11:57.051473 --- ParallelTerminationStrategy: PID 12420 died... 02:11:57.071572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminated: ok {rc=0} 02:11:57.118910 --- ParallelTerminationStrategy: PID 12423 died... 02:11:57.138919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminated: ok {rc=0} 02:11:57.186531 --- ParallelTerminationStrategy: PID 12426 died... 02:11:57.206652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Terminated: ok {rc=0} 02:11:57.296764 bus /sierra_3: Setting Powered False 02:11:58.398224 bus /sierra_3: Setting Powered False 02:11:59.517663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:12:00.670018 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:00.682733 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:12:00.741621 tst mo_mt_call_osmux.py: using LAC 25267 02:12:00.895172 tst mo_mt_call_osmux.py: using RAC 22 02:12:01.036848 tst mo_mt_call_osmux.py: using CellId 25267 02:12:01.162556 tst mo_mt_call_osmux.py: using BVCI 25268 02:12:01.317903 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:01.334091 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:01.350906 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:01.367521 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:01.385232 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:01.400081 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:01.549597 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:01.679157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:02.260616 run create_hlr_db(pid=12429): Launched 02:12:02.415408 bus /sierra_2: Setting Powered False 02:12:03.481033 run create_hlr_db(pid=12429): Terminated: ok {rc=0} 02:12:03.948146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12431): Launched 02:12:04.287736 run osmo-hlr_10.42.42.2(pid=12432): Launched 02:12:04.415436 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:04.996457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12434): Launched 02:12:05.333897 run osmo-stp_10.42.42.5(pid=12435): Launched 02:12:05.461561 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:06.066924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12437): Launched 02:12:06.404006 run osmo-msc_10.42.42.6(pid=12438): Launched 02:12:06.590474 run osmo-stp_10.42.42.5(pid=12435): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12435)] 02:12:06.731651 run osmo-stp_10.42.42.5(pid=12435): stdout: | (launched: 2022-12-10_02:12:05.271015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:06.873147 run osmo-stp_10.42.42.5(pid=12435): stderr: | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021205469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:07.013299 run osmo-stp_10.42.42.5(pid=12435): stdout: | (launched: 2022-12-10_02:12:05.271015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:07.145967 run osmo-stp_10.42.42.5(pid=12435): stderr: | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021205468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021205469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021205469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:07.305430 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12435): Process ended prematurely: osmo-stp_10.42.42.5(pid=12435) [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12435)] [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:12:07.315202 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 02:12:07.343427 run osmo-hlr_10.42.42.2(pid=12432): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12432)] 02:12:07.394142 run osmo-hlr_10.42.42.2(pid=12432): stdout: | (launched: 2022-12-10_02:12:04.224878) 02:12:07.446578 run osmo-hlr_10.42.42.2(pid=12432): stderr: | [0;m[1;31m20221210021204427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021204427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021204427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021204427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021204427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021204428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021204440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021204449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021204449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021204449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:07.519588 run osmo-msc_10.42.42.6(pid=12438): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12438)] 02:12:07.570182 run osmo-msc_10.42.42.6(pid=12438): stdout: | (launched: 2022-12-10_02:12:06.341213) 02:12:07.622734 run osmo-msc_10.42.42.6(pid=12438): stderr: | [0;m[38;5;43m20221210021206668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021206668 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25ea2fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021206668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021206668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021206669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021206669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021206670 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021206671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021206671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021206671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:07.675290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12431): Terminating (SIGTERM) 02:12:07.717840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12434): Terminating (SIGTERM) 02:12:07.760179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12437): Terminating (SIGTERM) 02:12:07.802778 --- ParallelTerminationStrategy: PID 12431 died... 02:12:07.822816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12431): Terminated: ok {rc=0} 02:12:07.869817 --- ParallelTerminationStrategy: PID 12434 died... 02:12:07.889638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12434): Terminated: ok {rc=0} 02:12:07.936256 --- ParallelTerminationStrategy: PID 12437 died... 02:12:07.956037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12437): Terminated: ok {rc=0} 02:12:08.045313 bus /sierra_3: Setting Powered False 02:12:09.145176 bus /sierra_3: Setting Powered False 02:12:10.262229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:12:11.502447 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:11.508574 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:12:11.530594 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:12:11.558641 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:12:11.612243 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:12:11.633772 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:12:11.661277 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:12:12.213216 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:12:12.267024 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.278580 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:12:12.337442 tst mo_mt_call.py: using LAC 25268 02:12:12.470359 tst mo_mt_call.py: using RAC 23 02:12:12.605362 tst mo_mt_call.py: using CellId 25268 02:12:12.735131 tst mo_mt_call.py: using BVCI 25269 02:12:12.856590 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.868031 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.879221 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.890563 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.902377 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:12.914276 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:13.033180 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:13.155362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:13.645175 run create_hlr_db(pid=12443): Launched 02:12:13.766165 bus /sierra_2: Setting Powered False 02:12:14.828467 run create_hlr_db(pid=12443): Terminated: ok {rc=0} 02:12:15.287089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Launched 02:12:15.623688 run osmo-hlr_10.42.42.2(pid=12446): Launched 02:12:15.752180 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:16.404165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Launched 02:12:16.758636 run osmo-stp_10.42.42.5(pid=12449): Launched 02:12:17.013656 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:17.827303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Launched 02:12:18.165086 run osmo-msc_10.42.42.6(pid=12452): Launched 02:12:18.351767 run osmo-stp_10.42.42.5(pid=12449): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] 02:12:18.491968 run osmo-stp_10.42.42.5(pid=12449): stdout: | (launched: 2022-12-10_02:12:16.694398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:18.633572 run osmo-stp_10.42.42.5(pid=12449): stderr: | [0;m[38;5;43m20221210021217068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021217068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021217069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021217071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:18.773865 run osmo-stp_10.42.42.5(pid=12449): stdout: | (launched: 2022-12-10_02:12:16.694398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:18.907461 run osmo-stp_10.42.42.5(pid=12449): stderr: | [0;m[38;5;43m20221210021217068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021217068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021217069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021217071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021217072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:19.067224 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12449): Process ended prematurely: osmo-stp_10.42.42.5(pid=12449) [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:12:19.077010 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 02:12:19.105169 run osmo-hlr_10.42.42.2(pid=12446): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12446)] 02:12:19.156159 run osmo-hlr_10.42.42.2(pid=12446): stdout: | (launched: 2022-12-10_02:12:15.560915) 02:12:19.208897 run osmo-hlr_10.42.42.2(pid=12446): stderr: | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021215762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021215777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021215788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021215788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021215788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:19.281917 run osmo-msc_10.42.42.6(pid=12452): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12452)] 02:12:19.332776 run osmo-msc_10.42.42.6(pid=12452): stdout: | (launched: 2022-12-10_02:12:18.101994) 02:12:19.385177 run osmo-msc_10.42.42.6(pid=12452): stderr: | [0;m[38;5;43m20221210021218428 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021218428 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f007150fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021218428 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021218428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021218429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021218429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021218431 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021218431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021218431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021218431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:19.437348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Terminating (SIGTERM) 02:12:19.479553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Terminating (SIGTERM) 02:12:19.521746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Terminating (SIGTERM) 02:12:19.564300 --- ParallelTerminationStrategy: PID 12445 died... 02:12:19.584677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Terminated: ok {rc=0} 02:12:19.632104 --- ParallelTerminationStrategy: PID 12448 died... 02:12:19.651939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Terminated: ok {rc=0} 02:12:19.698655 --- ParallelTerminationStrategy: PID 12451 died... 02:12:19.718409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Terminated: ok {rc=0} 02:12:19.808900 bus /sierra_3: Setting Powered False 02:12:20.910086 bus /sierra_3: Setting Powered False 02:12:22.029454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:12:23.178004 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.189841 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:12:23.250915 tst mo_mt_call_osmux.py: using LAC 25269 02:12:23.373583 tst mo_mt_call_osmux.py: using RAC 24 02:12:23.505553 tst mo_mt_call_osmux.py: using CellId 25269 02:12:23.629153 tst mo_mt_call_osmux.py: using BVCI 25270 02:12:23.743019 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.754099 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.764865 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.775947 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.787538 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:23.798671 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:23.917017 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:24.038795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:24.561672 run create_hlr_db(pid=12454): Launched 02:12:24.687453 bus /sierra_2: Setting Powered False 02:12:25.749264 run create_hlr_db(pid=12454): Terminated: ok {rc=0} 02:12:26.196766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12456): Launched 02:12:26.512117 run osmo-hlr_10.42.42.2(pid=12457): Launched 02:12:26.631973 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:27.191363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12459): Launched 02:12:27.507261 run osmo-stp_10.42.42.5(pid=12460): Launched 02:12:27.627581 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:28.222954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12462): Launched 02:12:28.562546 run osmo-msc_10.42.42.6(pid=12463): Launched 02:12:28.749172 run osmo-stp_10.42.42.5(pid=12460): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12460)] 02:12:28.889974 run osmo-stp_10.42.42.5(pid=12460): stdout: | (launched: 2022-12-10_02:12:27.447893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:29.032041 run osmo-stp_10.42.42.5(pid=12460): stderr: | [0;m[38;5;43m20221210021227622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021227623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021227623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021227623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:29.172218 run osmo-stp_10.42.42.5(pid=12460): stdout: | (launched: 2022-12-10_02:12:27.447893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:29.305757 run osmo-stp_10.42.42.5(pid=12460): stderr: | [0;m[38;5;43m20221210021227622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021227623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021227623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021227623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021227624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:29.465956 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12460): Process ended prematurely: osmo-stp_10.42.42.5(pid=12460) [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12460)] [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:12:29.475673 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:12:29.503842 run osmo-hlr_10.42.42.2(pid=12457): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12457)] 02:12:29.554995 run osmo-hlr_10.42.42.2(pid=12457): stdout: | (launched: 2022-12-10_02:12:26.453098) 02:12:29.608009 run osmo-hlr_10.42.42.2(pid=12457): stderr: | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021226635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021226647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021226656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021226656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021226656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:29.681146 run osmo-msc_10.42.42.6(pid=12463): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12463)] 02:12:29.732055 run osmo-msc_10.42.42.6(pid=12463): stdout: | (launched: 2022-12-10_02:12:28.499669) 02:12:29.784447 run osmo-msc_10.42.42.6(pid=12463): stderr: | [0;m[38;5;43m20221210021228828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021228828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f36afb41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021228828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021228828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021228828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021228829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021228830 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021228831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021228831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021228831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:29.837363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12456): Terminating (SIGTERM) 02:12:29.879822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12459): Terminating (SIGTERM) 02:12:29.922320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12462): Terminating (SIGTERM) 02:12:29.964623 --- ParallelTerminationStrategy: PID 12456 died... 02:12:29.985002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12456): Terminated: ok {rc=0} 02:12:30.031723 --- ParallelTerminationStrategy: PID 12459 died... 02:12:30.051600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12459): Terminated: ok {rc=0} 02:12:30.098522 --- ParallelTerminationStrategy: PID 12462 died... 02:12:30.118466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12462): Terminated: ok {rc=0} 02:12:30.207179 bus /sierra_3: Setting Powered False 02:12:31.306532 bus /sierra_3: Setting Powered False 02:12:32.423298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:sysmo --------------------------------------------------------------------- 02:12:33.654908 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:33.659116 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 02:12:33.679852 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 02:12:33.708539 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 02:12:33.792884 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 02:12:33.813663 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 02:12:33.840430 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 02:12:34.422709 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 02:12:34.427710 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:34.438388 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:12:34.474419 tst emergency_mo_mt_call.py: using LAC 25270 02:12:34.599176 tst emergency_mo_mt_call.py: using RAC 25 02:12:34.720223 tst emergency_mo_mt_call.py: using CellId 25270 02:12:34.838362 tst emergency_mo_mt_call.py: using BVCI 25271 02:12:34.951148 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:34.961868 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:34.972396 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:34.983180 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:34.993993 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:35.004775 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:35.124772 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:35.246441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:35.760087 run create_hlr_db(pid=12470): Launched 02:12:35.894718 bus /sierra_2: Setting Powered False 02:12:36.956299 run create_hlr_db(pid=12470): Terminated: ok {rc=0} 02:12:37.389843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Launched 02:12:37.700043 run osmo-hlr_10.42.42.2(pid=12476): Launched 02:12:37.817249 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:38.351624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Launched 02:12:38.662387 run osmo-stp_10.42.42.5(pid=12479): Launched 02:12:38.793254 tst emergency_mo_mt_call.py: using MSISDN 7502 02:12:38.962013 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:39.556041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12481): Launched 02:12:39.888534 run osmo-msc_10.42.42.6(pid=12482): Launched 02:12:40.071718 run osmo-stp_10.42.42.5(pid=12479): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] 02:12:40.210669 run osmo-stp_10.42.42.5(pid=12479): stdout: | (launched: 2022-12-10_02:12:38.603889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:40.349894 run osmo-stp_10.42.42.5(pid=12479): stderr: | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021238778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:40.487925 run osmo-stp_10.42.42.5(pid=12479): stdout: | (launched: 2022-12-10_02:12:38.603889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:40.618490 run osmo-stp_10.42.42.5(pid=12479): stderr: | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021238777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021238778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021238778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:40.774882 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12479): Process ended prematurely: osmo-stp_10.42.42.5(pid=12479) [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py:19] 02:12:40.783898 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 02:12:40.812085 run osmo-hlr_10.42.42.2(pid=12476): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12476)] 02:12:40.862579 run osmo-hlr_10.42.42.2(pid=12476): stdout: | (launched: 2022-12-10_02:12:37.641693) 02:12:40.914905 run osmo-hlr_10.42.42.2(pid=12476): stderr: | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021237821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021237837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021237847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021237847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021237847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:40.987884 run osmo-msc_10.42.42.6(pid=12482): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12482)] 02:12:41.038555 run osmo-msc_10.42.42.6(pid=12482): stdout: | (launched: 2022-12-10_02:12:39.826972) 02:12:41.090724 run osmo-msc_10.42.42.6(pid=12482): stderr: | [0;m[38;5;43m20221210021240151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021240151 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff648810c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021240152 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021240152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021240152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021240152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021240154 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021240154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021240155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021240155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:41.143571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Terminating (SIGTERM) 02:12:41.186189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Terminating (SIGTERM) 02:12:41.228591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12481): Terminating (SIGTERM) 02:12:41.271590 --- ParallelTerminationStrategy: PID 12475 died... 02:12:41.292054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Terminated: ok {rc=0} 02:12:41.339211 --- ParallelTerminationStrategy: PID 12478 died... 02:12:41.359300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Terminated: ok {rc=0} 02:12:41.406225 --- ParallelTerminationStrategy: PID 12481 died... 02:12:41.426300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12481): Terminated: ok {rc=0} 02:12:41.515726 bus /sierra_3: Setting Powered False 02:12:42.614930 bus /sierra_3: Setting Powered False 02:12:43.732753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 02:12:44.821691 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:44.833850 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:12:44.872436 tst emergency_preemptive_call.py: using LAC 25271 02:12:45.001810 tst emergency_preemptive_call.py: using RAC 26 02:12:45.122985 tst emergency_preemptive_call.py: using CellId 25271 02:12:45.245893 tst emergency_preemptive_call.py: using BVCI 25272 02:12:45.357757 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:45.368667 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:45.379336 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:45.390201 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:45.401115 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:12:45.411867 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:45.529111 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:45.648617 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:45.768264 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:12:45.893685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:46.428692 run create_hlr_db(pid=12484): Launched 02:12:46.594667 bus /sierra_2: Setting Powered False 02:12:47.659331 run create_hlr_db(pid=12484): Terminated: ok {rc=0} 02:12:48.102926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Launched 02:12:48.414461 run osmo-hlr_10.42.42.2(pid=12487): Launched 02:12:48.532584 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:49.081630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Launched 02:12:49.392133 run osmo-stp_10.42.42.5(pid=12490): Launched 02:12:49.519021 tst emergency_preemptive_call.py: using MSISDN 7503 02:12:49.677352 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:50.232750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Launched 02:12:50.541366 run osmo-msc_10.42.42.6(pid=12493): Launched 02:12:50.721833 run osmo-stp_10.42.42.5(pid=12490): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] 02:12:50.852862 run osmo-stp_10.42.42.5(pid=12490): stdout: | (launched: 2022-12-10_02:12:49.333810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:50.984333 run osmo-stp_10.42.42.5(pid=12490): stderr: | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021249507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:51.114264 run osmo-stp_10.42.42.5(pid=12490): stdout: | (launched: 2022-12-10_02:12:49.333810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:51.237127 run osmo-stp_10.42.42.5(pid=12490): stderr: | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021249506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021249507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021249507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:51.384036 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12490): Process ended prematurely: osmo-stp_10.42.42.5(pid=12490) [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py:32] 02:12:51.392548 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 02:12:51.418779 run osmo-hlr_10.42.42.2(pid=12487): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12487)] 02:12:51.467470 run osmo-hlr_10.42.42.2(pid=12487): stdout: | (launched: 2022-12-10_02:12:48.355995) 02:12:51.517622 run osmo-hlr_10.42.42.2(pid=12487): stderr: | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021248535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021248547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021248556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021248556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021248556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:51.587647 run osmo-msc_10.42.42.6(pid=12493): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12493)] 02:12:51.635946 run osmo-msc_10.42.42.6(pid=12493): stdout: | (launched: 2022-12-10_02:12:50.483359) 02:12:51.685816 run osmo-msc_10.42.42.6(pid=12493): stderr: | [0;m[38;5;43m20221210021250758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021250758 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1708bccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021250758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021250758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021250759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021250759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021250761 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021250761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021250761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021250761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:51.736116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Terminating (SIGTERM) 02:12:51.776409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Terminating (SIGTERM) 02:12:51.816674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Terminating (SIGTERM) 02:12:51.857235 --- ParallelTerminationStrategy: PID 12486 died... 02:12:51.876456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Terminated: ok {rc=0} 02:12:51.921429 --- ParallelTerminationStrategy: PID 12489 died... 02:12:51.940212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Terminated: ok {rc=0} 02:12:51.985527 --- ParallelTerminationStrategy: PID 12492 died... 02:12:52.004374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Terminated: ok {rc=0} 02:12:52.091494 bus /sierra_9: Setting Powered False 02:12:53.192234 bus /sierra_9: Setting Powered False 02:12:54.309548 bus /sierra_8: Setting Powered False 02:12:55.406511 bus /sierra_8: Setting Powered False 02:12:56.521670 bus /sierra_3: Setting Powered False 02:12:57.620547 bus /sierra_3: Setting Powered False 02:12:58.736886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:sysmo --------------------------------------------------------------------- 02:12:59.995527 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:00.001034 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 02:13:00.023482 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 02:13:00.063338 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 02:13:00.153744 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 02:13:00.175166 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 02:13:00.215637 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 02:13:00.807718 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 02:13:00.872353 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:00.884353 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:00.927723 tst cs_paging_gprs_active.py: using LAC 25272 02:13:01.058988 tst cs_paging_gprs_active.py: using RAC 27 02:13:01.205131 tst cs_paging_gprs_active.py: using CellId 25272 02:13:01.331060 tst cs_paging_gprs_active.py: using BVCI 25273 02:13:01.478614 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.490489 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.502176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.515440 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.528211 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.539882 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.552427 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.565463 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:01.579572 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:01.704853 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:01.830847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:13:02.063908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:02.428351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Launched 02:13:02.722286 run iperf3-srv_10.42.42.10(pid=12499): Launched 02:13:02.848925 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:13:03.075362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:03.415132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Launched 02:13:03.708154 run iperf3-srv_10.42.42.10(pid=12501): Launched 02:13:03.834779 tst cs_paging_gprs_active.py:38: start network... 02:13:04.061791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:04.588545 run create_hlr_db(pid=12502): Launched 02:13:04.727876 bus /sierra_2: Setting Powered False 02:13:05.793808 run create_hlr_db(pid=12502): Terminated: ok {rc=0} 02:13:06.262815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Launched 02:13:06.601047 run osmo-hlr_10.42.42.2(pid=12505): Launched 02:13:06.729957 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:07.309376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Launched 02:13:07.647433 run osmo-stp_10.42.42.5(pid=12508): Launched 02:13:07.775697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:09.368077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Launched 02:13:09.496191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:09.781644 run patchelf(pid=12511): Launched 02:13:09.968903 run osmo-stp_10.42.42.5(pid=12508): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] 02:13:10.110614 run osmo-stp_10.42.42.5(pid=12508): stdout: | (launched: 2022-12-10_02:13:07.584014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:10.254424 run osmo-stp_10.42.42.5(pid=12508): stderr: | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021307779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:10.397648 run osmo-stp_10.42.42.5(pid=12508): stdout: | (launched: 2022-12-10_02:13:07.584014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:10.534744 run osmo-stp_10.42.42.5(pid=12508): stderr: | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021307779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021307779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021307783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:10.697429 run patchelf(pid=12511): Terminating (SIGINT) 02:13:10.884351 run patchelf(pid=12511): Terminated: ok {rc=0} 02:13:11.019744 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12508): Process ended prematurely: osmo-stp_10.42.42.5(pid=12508) [trial-2368↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] [trial-2368↪gprs:sysmo↪cs_paging_gprs_active.py:38] 02:13:11.029889 tst cs_paging_gprs_active.py:38: Test FAILED (10.2 sec) 02:13:11.058333 run osmo-hlr_10.42.42.2(pid=12505): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12505)] 02:13:11.108865 run osmo-hlr_10.42.42.2(pid=12505): stdout: | (launched: 2022-12-10_02:13:06.537833) 02:13:11.160813 run osmo-hlr_10.42.42.2(pid=12505): stderr: | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021306739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021306764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021306773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021306773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021306773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:11.213729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Terminating (SIGTERM) 02:13:11.255725 run iperf3-srv_10.42.42.10(pid=12499): Terminating (SIGTERM) 02:13:11.297459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Terminating (SIGTERM) 02:13:11.339369 run iperf3-srv_10.42.42.10(pid=12501): Terminating (SIGTERM) 02:13:11.381083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Terminating (SIGTERM) 02:13:11.423090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Terminating (SIGTERM) 02:13:11.464894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Terminating (SIGTERM) 02:13:11.506961 --- ParallelTerminationStrategy: PID 12498 died... 02:13:11.527072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12498): Terminated: ok {rc=0} 02:13:11.573515 --- ParallelTerminationStrategy: PID 12499 died... 02:13:11.593203 run iperf3-srv_10.42.42.10(pid=12499): Terminated {rc=256} 02:13:11.639414 --- ParallelTerminationStrategy: PID 12500 died... 02:13:11.659081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12500): Terminated: ok {rc=0} 02:13:11.705874 --- ParallelTerminationStrategy: PID 12501 died... 02:13:11.725754 run iperf3-srv_10.42.42.10(pid=12501): Terminated {rc=256} 02:13:11.772797 --- ParallelTerminationStrategy: PID 12504 died... 02:13:11.793012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12504): Terminated: ok {rc=0} 02:13:11.839421 --- ParallelTerminationStrategy: PID 12507 died... 02:13:11.859069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12507): Terminated: ok {rc=0} 02:13:11.905610 --- ParallelTerminationStrategy: PID 12510 died... 02:13:11.925521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12510): Terminated: ok {rc=0} 02:13:12.014770 bus /gobi_0: Setting Powered False 02:13:13.116049 bus /gobi_0: Setting Powered False 02:13:14.235334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo iperf3.py ---------------------------------------------- 02:13:15.389716 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:15.401533 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:15.439286 tst iperf3.py: using LAC 25273 02:13:15.572243 tst iperf3.py: using RAC 28 02:13:15.697557 tst iperf3.py: using CellId 25273 02:13:15.829053 tst iperf3.py: using BVCI 25274 02:13:15.963060 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:15.974947 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:15.986938 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:15.998731 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:16.010227 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:16.021929 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:16.033765 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:16.045442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:16.057258 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:16.201565 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:13:16.434057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:16.779724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Launched 02:13:17.089310 run iperf3-srv_10.42.42.10(pid=12513): Launched 02:13:17.220512 tst iperf3.py:8: start network... 02:13:17.446482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:17.968901 run create_hlr_db(pid=12514): Launched 02:13:18.106127 bus /gobi_6: Setting Powered False 02:13:19.171664 run create_hlr_db(pid=12514): Terminated: ok {rc=0} 02:13:19.620502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Launched 02:13:19.938019 run osmo-hlr_10.42.42.2(pid=12517): Launched 02:13:20.057817 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:20.609160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Launched 02:13:20.924099 run osmo-stp_10.42.42.5(pid=12520): Launched 02:13:21.043435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:21.584599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Launched 02:13:21.704672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:21.971302 run patchelf(pid=12523): Launched 02:13:22.146017 run osmo-stp_10.42.42.5(pid=12520): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] 02:13:22.278906 run osmo-stp_10.42.42.5(pid=12520): stdout: | (launched: 2022-12-10_02:13:20.864474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:22.413266 run osmo-stp_10.42.42.5(pid=12520): stderr: | [0;m[38;5;43m20221210021321038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021321038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021321039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021321039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021321041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021321042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021321042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:22.547329 run osmo-stp_10.42.42.5(pid=12520): stdout: | (launched: 2022-12-10_02:13:20.864474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:22.676115 run osmo-stp_10.42.42.5(pid=12520): stderr: | [0;m[38;5;43m20221210021321038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021321038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021321039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021321039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021321041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021321042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021321042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:22.828429 run patchelf(pid=12523): Terminating (SIGINT) 02:13:23.004521 run patchelf(pid=12523): Terminated: ok {rc=0} 02:13:23.131285 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12520): Process ended prematurely: osmo-stp_10.42.42.5(pid=12520) [trial-2368↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] [trial-2368↪gprs:sysmo↪iperf3.py:8] 02:13:23.140707 tst iperf3.py:8: Test FAILED (7.8 sec) 02:13:23.168445 run osmo-hlr_10.42.42.2(pid=12517): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12517)] 02:13:23.217089 run osmo-hlr_10.42.42.2(pid=12517): stdout: | (launched: 2022-12-10_02:13:19.878071) 02:13:23.267139 run osmo-hlr_10.42.42.2(pid=12517): stderr: | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021320061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021320074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021320083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021320083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021320083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:23.318653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Terminating (SIGTERM) 02:13:23.359084 run iperf3-srv_10.42.42.10(pid=12513): Terminating (SIGTERM) 02:13:23.399398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Terminating (SIGTERM) 02:13:23.440084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Terminating (SIGTERM) 02:13:23.480449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Terminating (SIGTERM) 02:13:23.521079 --- ParallelTerminationStrategy: PID 12512 died... 02:13:23.540364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12512): Terminated: ok {rc=0} 02:13:23.585315 --- ParallelTerminationStrategy: PID 12513 died... 02:13:23.604024 run iperf3-srv_10.42.42.10(pid=12513): Terminated {rc=256} 02:13:23.649324 --- ParallelTerminationStrategy: PID 12516 died... 02:13:23.668055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12516): Terminated: ok {rc=0} 02:13:23.712751 --- ParallelTerminationStrategy: PID 12519 died... 02:13:23.731775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12519): Terminated: ok {rc=0} 02:13:23.776703 --- ParallelTerminationStrategy: PID 12522 died... 02:13:23.795620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12522): Terminated: ok {rc=0} 02:13:23.882374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo iperf3m4.py ---------------------------------------------- 02:13:25.033976 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.045578 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:25.086221 tst iperf3m4.py: using LAC 25274 02:13:25.210710 tst iperf3m4.py: using RAC 29 02:13:25.341952 tst iperf3m4.py: using CellId 25274 02:13:25.471916 tst iperf3m4.py: using BVCI 25275 02:13:25.593928 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.605114 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.616146 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.627172 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.638144 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.648895 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.660122 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.671087 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:25.682355 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:25.800480 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:25.925873 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:26.044189 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:26.167219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:13:26.378659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:26.696271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Launched 02:13:26.971855 run iperf3-srv_10.42.42.10(pid=12525): Launched 02:13:27.090796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:13:27.302337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:27.620756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Launched 02:13:27.895781 run iperf3-srv_10.42.42.10(pid=12527): Launched 02:13:28.014383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:13:28.225149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:28.542689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Launched 02:13:28.817226 run iperf3-srv_10.42.42.10(pid=12529): Launched 02:13:28.935036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:13:29.144331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:29.460265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Launched 02:13:29.750907 run iperf3-srv_10.42.42.10(pid=12531): Launched 02:13:29.869234 tst iperf3m4.py:8: start network... 02:13:30.079082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:30.569309 run create_hlr_db(pid=12532): Launched 02:13:30.689251 bus /gobi_6: Setting Powered False 02:13:31.754313 run create_hlr_db(pid=12532): Terminated: ok {rc=0} 02:13:32.248511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Launched 02:13:32.598225 run osmo-hlr_10.42.42.2(pid=12535): Launched 02:13:32.727027 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:33.313872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Launched 02:13:33.652263 run osmo-stp_10.42.42.5(pid=12538): Launched 02:13:33.781516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:34.363300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Launched 02:13:34.492100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:34.777332 run patchelf(pid=12541): Launched 02:13:34.964324 run osmo-stp_10.42.42.5(pid=12538): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] 02:13:35.106451 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-10_02:13:33.589392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:35.250203 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221210021333784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021333784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021333785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021333785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:35.393593 run osmo-stp_10.42.42.5(pid=12538): stdout: | (launched: 2022-12-10_02:13:33.589392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:35.531247 run osmo-stp_10.42.42.5(pid=12538): stderr: | [0;m[38;5;43m20221210021333784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021333784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021333785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021333785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021333786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:35.694866 run patchelf(pid=12541): Terminating (SIGINT) 02:13:35.882609 run patchelf(pid=12541): Terminated: ok {rc=0} 02:13:36.018848 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2368↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] [trial-2368↪gprs:sysmo↪iperf3m4.py:8] 02:13:36.029027 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:13:36.057914 run osmo-hlr_10.42.42.2(pid=12535): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12535)] 02:13:36.108854 run osmo-hlr_10.42.42.2(pid=12535): stdout: | (launched: 2022-12-10_02:13:32.535135) 02:13:36.161114 run osmo-hlr_10.42.42.2(pid=12535): stderr: | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021332736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021332748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021332759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021332759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021332759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:36.214053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Terminating (SIGTERM) 02:13:36.256234 run iperf3-srv_10.42.42.10(pid=12525): Terminating (SIGTERM) 02:13:36.298527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Terminating (SIGTERM) 02:13:36.340831 run iperf3-srv_10.42.42.10(pid=12527): Terminating (SIGTERM) 02:13:36.384383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Terminating (SIGTERM) 02:13:36.428106 run iperf3-srv_10.42.42.10(pid=12529): Terminating (SIGTERM) 02:13:36.470490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminating (SIGTERM) 02:13:36.512722 run iperf3-srv_10.42.42.10(pid=12531): Terminating (SIGTERM) 02:13:36.554848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminating (SIGTERM) 02:13:36.597088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminating (SIGTERM) 02:13:36.639291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminating (SIGTERM) 02:13:36.681789 --- ParallelTerminationStrategy: PID 12524 died... 02:13:36.702077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12524): Terminated: ok {rc=0} 02:13:36.748861 --- ParallelTerminationStrategy: PID 12525 died... 02:13:36.768802 run iperf3-srv_10.42.42.10(pid=12525): Terminated {rc=256} 02:13:36.815255 --- ParallelTerminationStrategy: PID 12526 died... 02:13:36.835097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12526): Terminated: ok {rc=0} 02:13:36.881533 --- ParallelTerminationStrategy: PID 12527 died... 02:13:36.901365 run iperf3-srv_10.42.42.10(pid=12527): Terminated {rc=256} 02:13:36.947936 --- ParallelTerminationStrategy: PID 12528 died... 02:13:36.967798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12528): Terminated: ok {rc=0} 02:13:37.014937 --- ParallelTerminationStrategy: PID 12529 died... 02:13:37.034864 run iperf3-srv_10.42.42.10(pid=12529): Terminated {rc=256} 02:13:37.081322 --- ParallelTerminationStrategy: PID 12530 died... 02:13:37.101263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12530): Terminated: ok {rc=0} 02:13:37.147691 --- ParallelTerminationStrategy: PID 12531 died... 02:13:37.167399 run iperf3-srv_10.42.42.10(pid=12531): Terminated {rc=256} 02:13:37.214230 --- ParallelTerminationStrategy: PID 12534 died... 02:13:37.233944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12534): Terminated: ok {rc=0} 02:13:37.280637 --- ParallelTerminationStrategy: PID 12537 died... 02:13:37.300484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12537): Terminated: ok {rc=0} 02:13:37.347703 --- ParallelTerminationStrategy: PID 12540 died... 02:13:37.367689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12540): Terminated: ok {rc=0} 02:13:37.457725 bus /gobi_4: Setting Powered False 02:13:38.558702 bus /gobi_4: Setting Powered False 02:13:39.677947 bus /gobi_1: Setting Powered False 02:13:40.777082 bus /gobi_1: Setting Powered False 02:13:41.894257 bus /gobi_0: Setting Powered False 02:13:42.992840 bus /gobi_0: Setting Powered False 02:13:44.111124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo ping.py ---------------------------------------------- 02:13:45.216593 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.228329 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:45.270349 tst ping.py: using LAC 25275 02:13:45.400691 tst ping.py: using RAC 30 02:13:45.527293 tst ping.py: using CellId 25275 02:13:45.654569 tst ping.py: using BVCI 25276 02:13:45.773900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.785214 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.796375 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.807526 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.818558 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.829415 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.840490 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.852047 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:45.986610 tst ping.py:19: start network... 02:13:46.264534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:46.859620 run create_hlr_db(pid=12542): Launched 02:13:47.025699 bus /gobi_6: Setting Powered False 02:13:48.090759 run create_hlr_db(pid=12542): Terminated: ok {rc=0} 02:13:48.533986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Launched 02:13:48.844208 run osmo-hlr_10.42.42.2(pid=12545): Launched 02:13:48.961520 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:49.502338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Launched 02:13:49.811422 run osmo-stp_10.42.42.5(pid=12548): Launched 02:13:49.928387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:50.459646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Launched 02:13:50.578908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:50.841246 run patchelf(pid=12551): Launched 02:13:51.013232 run osmo-stp_10.42.42.5(pid=12548): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] 02:13:51.144123 run osmo-stp_10.42.42.5(pid=12548): stdout: | (launched: 2022-12-10_02:13:49.753144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:51.276402 run osmo-stp_10.42.42.5(pid=12548): stderr: | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021349925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:51.408764 run osmo-stp_10.42.42.5(pid=12548): stdout: | (launched: 2022-12-10_02:13:49.753144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:51.535252 run osmo-stp_10.42.42.5(pid=12548): stderr: | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021349924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021349925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021349927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:51.684581 run patchelf(pid=12551): Terminating (SIGINT) 02:13:51.857680 run patchelf(pid=12551): Terminated: ok {rc=0} 02:13:51.982047 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12548): Process ended prematurely: osmo-stp_10.42.42.5(pid=12548) [trial-2368↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] [trial-2368↪gprs:sysmo↪ping.py:22] 02:13:51.990886 tst ping.py:22: Test FAILED (6.8 sec) 02:13:52.018359 run osmo-hlr_10.42.42.2(pid=12545): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12545)] 02:13:52.067721 run osmo-hlr_10.42.42.2(pid=12545): stdout: | (launched: 2022-12-10_02:13:48.785719) 02:13:52.118897 run osmo-hlr_10.42.42.2(pid=12545): stderr: | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021348962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021348974 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021348985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021348985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021348985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:52.170138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Terminating (SIGTERM) 02:13:52.211278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Terminating (SIGTERM) 02:13:52.252582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Terminating (SIGTERM) 02:13:52.294082 --- ParallelTerminationStrategy: PID 12544 died... 02:13:52.313933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12544): Terminated: ok {rc=0} 02:13:52.359858 --- ParallelTerminationStrategy: PID 12547 died... 02:13:52.379141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12547): Terminated: ok {rc=0} 02:13:52.424607 --- ParallelTerminationStrategy: PID 12550 died... 02:13:52.444013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12550): Terminated: ok {rc=0} 02:13:52.532813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 02:13:53.623486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:53.635362 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:53.673434 tst ping_idle_ping.py: using LAC 25276 02:13:53.805532 tst ping_idle_ping.py: using RAC 31 02:13:53.936195 tst ping_idle_ping.py: using CellId 25276 02:13:54.068198 tst ping_idle_ping.py: using BVCI 25277 02:13:54.182283 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.193578 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.204306 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.215507 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.226720 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.237842 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.248877 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:54.260182 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:54.392089 tst ping_idle_ping.py:24: start network... 02:13:54.617258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:55.129540 run create_hlr_db(pid=12552): Launched 02:13:55.255602 bus /gobi_6: Setting Powered False 02:13:56.317608 run create_hlr_db(pid=12552): Terminated: ok {rc=0} 02:13:56.750605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Launched 02:13:57.061336 run osmo-hlr_10.42.42.2(pid=12555): Launched 02:13:57.179359 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:57.725129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Launched 02:13:58.034927 run osmo-stp_10.42.42.5(pid=12558): Launched 02:13:58.152047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:58.687702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Launched 02:13:58.807275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:59.070438 run patchelf(pid=12561): Launched 02:13:59.242802 run osmo-stp_10.42.42.5(pid=12558): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] 02:13:59.373585 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-10_02:13:57.976407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:59.506569 run osmo-stp_10.42.42.5(pid=12558): stderr: | [0;m[38;5;43m20221210021358150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021358151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021358151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021358151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:59.639423 run osmo-stp_10.42.42.5(pid=12558): stdout: | (launched: 2022-12-10_02:13:57.976407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:59.766956 run osmo-stp_10.42.42.5(pid=12558): stderr: | [0;m[38;5;43m20221210021358150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021358151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021358151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021358151 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021358152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:59.917383 run patchelf(pid=12561): Terminating (SIGINT) 02:14:00.091173 run patchelf(pid=12561): Terminated: ok {rc=0} 02:14:00.216564 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2368↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] [trial-2368↪gprs:sysmo↪ping_idle_ping.py:27] 02:14:00.225524 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:14:00.252478 run osmo-hlr_10.42.42.2(pid=12555): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12555)] 02:14:00.301780 run osmo-hlr_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-10_02:13:57.002450) 02:14:00.352114 run osmo-hlr_10.42.42.2(pid=12555): stderr: | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021357183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021357199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021357209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021357209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021357209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:00.402879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminating (SIGTERM) 02:14:00.443694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminating (SIGTERM) 02:14:00.484562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Terminating (SIGTERM) 02:14:00.525497 --- ParallelTerminationStrategy: PID 12554 died... 02:14:00.544761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12554): Terminated: ok {rc=0} 02:14:00.590600 --- ParallelTerminationStrategy: PID 12557 died... 02:14:00.609857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12557): Terminated: ok {rc=0} 02:14:00.654662 --- ParallelTerminationStrategy: PID 12560 died... 02:14:00.673406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12560): Terminated: ok {rc=0} 02:14:00.760630 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 02:14:02.076716 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:14:02.086682 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:14:02.117514 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:14:02.165984 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:14:02.257897 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:14:02.279673 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:14:02.321032 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:14:02.918003 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:14:02.972758 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:02.984146 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:03.023388 tst cs_paging_gprs_active.py: using LAC 25277 02:14:03.157169 tst cs_paging_gprs_active.py: using RAC 32 02:14:03.289982 tst cs_paging_gprs_active.py: using CellId 25277 02:14:03.426731 tst cs_paging_gprs_active.py: using BVCI 25278 02:14:03.552611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.564031 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.575214 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.587021 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.598619 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.610211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.622082 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.633710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:03.645750 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:03.768670 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:03.889493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:14:04.103813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:04.423872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12565): Launched 02:14:04.702238 run iperf3-srv_10.42.42.10(pid=12566): Launched 02:14:04.821492 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:14:05.033630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:05.352770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12567): Launched 02:14:05.628509 run iperf3-srv_10.42.42.10(pid=12568): Launched 02:14:05.747197 tst cs_paging_gprs_active.py:38: start network... 02:14:05.958404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:06.447834 run create_hlr_db(pid=12569): Launched 02:14:06.569860 bus /gobi_6: Setting Powered False 02:14:07.632064 run create_hlr_db(pid=12569): Terminated: ok {rc=0} 02:14:08.091108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12571): Launched 02:14:08.430036 run osmo-hlr_10.42.42.2(pid=12572): Launched 02:14:08.559058 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:09.141482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12574): Launched 02:14:09.481568 run osmo-stp_10.42.42.5(pid=12575): Launched 02:14:09.612863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:10.194511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12577): Launched 02:14:10.323869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:10.610154 run patchelf(pid=12578): Launched 02:14:10.797333 run osmo-stp_10.42.42.5(pid=12575): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12575)] 02:14:10.939171 run osmo-stp_10.42.42.5(pid=12575): stdout: | (launched: 2022-12-10_02:14:09.418025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:11.082570 run osmo-stp_10.42.42.5(pid=12575): stderr: | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021409618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:11.225916 run osmo-stp_10.42.42.5(pid=12575): stdout: | (launched: 2022-12-10_02:14:09.418025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:11.363940 run osmo-stp_10.42.42.5(pid=12575): stderr: | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021409617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021409618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021409618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:11.527157 run patchelf(pid=12578): Terminating (SIGINT) 02:14:11.714840 run patchelf(pid=12578): Terminated: ok {rc=0} 02:14:11.850621 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12575): Process ended prematurely: osmo-stp_10.42.42.5(pid=12575) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12575)] [trial-2368↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:14:11.860803 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:14:11.889744 run osmo-hlr_10.42.42.2(pid=12572): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12572)] 02:14:11.940299 run osmo-hlr_10.42.42.2(pid=12572): stdout: | (launched: 2022-12-10_02:14:08.366785) 02:14:11.992681 run osmo-hlr_10.42.42.2(pid=12572): stderr: | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021408570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021408584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021408592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021408593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021408593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:12.045597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12565): Terminating (SIGTERM) 02:14:12.088349 run iperf3-srv_10.42.42.10(pid=12566): Terminating (SIGTERM) 02:14:12.130957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12567): Terminating (SIGTERM) 02:14:12.173664 run iperf3-srv_10.42.42.10(pid=12568): Terminating (SIGTERM) 02:14:12.216118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12571): Terminating (SIGTERM) 02:14:12.258972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12574): Terminating (SIGTERM) 02:14:12.301856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12577): Terminating (SIGTERM) 02:14:12.344730 --- ParallelTerminationStrategy: PID 12565 died... 02:14:12.365145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12565): Terminated: ok {rc=0} 02:14:12.412394 --- ParallelTerminationStrategy: PID 12566 died... 02:14:12.432286 run iperf3-srv_10.42.42.10(pid=12566): Terminated {rc=256} 02:14:12.479140 --- ParallelTerminationStrategy: PID 12567 died... 02:14:12.499174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12567): Terminated: ok {rc=0} 02:14:12.545886 --- ParallelTerminationStrategy: PID 12568 died... 02:14:12.565681 run iperf3-srv_10.42.42.10(pid=12568): Terminated {rc=256} 02:14:12.612333 --- ParallelTerminationStrategy: PID 12571 died... 02:14:12.632189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12571): Terminated: ok {rc=0} 02:14:12.678957 --- ParallelTerminationStrategy: PID 12574 died... 02:14:12.699146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12574): Terminated: ok {rc=0} 02:14:12.746241 --- ParallelTerminationStrategy: PID 12577 died... 02:14:12.766203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12577): Terminated: ok {rc=0} 02:14:12.853998 bus /gobi_0: Setting Powered False 02:14:13.953944 bus /gobi_0: Setting Powered False 02:14:15.069685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:14:16.227315 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.239880 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:16.280154 tst iperf3.py: using LAC 25278 02:14:16.405603 tst iperf3.py: using RAC 33 02:14:16.537824 tst iperf3.py: using CellId 25278 02:14:16.672585 tst iperf3.py: using BVCI 25279 02:14:16.792334 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.804701 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.816851 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.829880 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.843416 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.856198 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.868174 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.882407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:16.896380 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:17.019101 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:17.251487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:17.591314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Launched 02:14:17.884679 run iperf3-srv_10.42.42.10(pid=12580): Launched 02:14:18.011209 tst iperf3.py:8: start network... 02:14:18.237860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:18.760756 run create_hlr_db(pid=12581): Launched 02:14:18.898167 bus /gobi_6: Setting Powered False 02:14:19.963440 run create_hlr_db(pid=12581): Terminated: ok {rc=0} 02:14:20.411868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Launched 02:14:20.729092 run osmo-hlr_10.42.42.2(pid=12584): Launched 02:14:20.850495 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:21.391397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Launched 02:14:21.706398 run osmo-stp_10.42.42.5(pid=12587): Launched 02:14:21.826415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:22.369637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12589): Launched 02:14:22.490317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:22.758069 run patchelf(pid=12590): Launched 02:14:22.932392 run osmo-stp_10.42.42.5(pid=12587): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] 02:14:23.064583 run osmo-stp_10.42.42.5(pid=12587): stdout: | (launched: 2022-12-10_02:14:21.647147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:23.198342 run osmo-stp_10.42.42.5(pid=12587): stderr: | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021421822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:23.332492 run osmo-stp_10.42.42.5(pid=12587): stdout: | (launched: 2022-12-10_02:14:21.647147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:23.461520 run osmo-stp_10.42.42.5(pid=12587): stderr: | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021421822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021421822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021421823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:23.613556 run patchelf(pid=12590): Terminating (SIGINT) 02:14:23.789140 run patchelf(pid=12590): Terminated: ok {rc=0} 02:14:23.915814 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12587): Process ended prematurely: osmo-stp_10.42.42.5(pid=12587) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 02:14:23.925410 tst iperf3.py:8: Test FAILED (7.7 sec) 02:14:23.953454 run osmo-hlr_10.42.42.2(pid=12584): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12584)] 02:14:24.002109 run osmo-hlr_10.42.42.2(pid=12584): stdout: | (launched: 2022-12-10_02:14:20.669508) 02:14:24.052381 run osmo-hlr_10.42.42.2(pid=12584): stderr: | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021420851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021420892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021420902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021420902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021420902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:24.103140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Terminating (SIGTERM) 02:14:24.143786 run iperf3-srv_10.42.42.10(pid=12580): Terminating (SIGTERM) 02:14:24.184184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Terminating (SIGTERM) 02:14:24.224896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Terminating (SIGTERM) 02:14:24.265127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12589): Terminating (SIGTERM) 02:14:24.305848 --- ParallelTerminationStrategy: PID 12579 died... 02:14:24.325237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Terminated: ok {rc=0} 02:14:24.370313 --- ParallelTerminationStrategy: PID 12580 died... 02:14:24.389159 run iperf3-srv_10.42.42.10(pid=12580): Terminated {rc=256} 02:14:24.433809 --- ParallelTerminationStrategy: PID 12583 died... 02:14:24.452605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12583): Terminated: ok {rc=0} 02:14:24.497150 --- ParallelTerminationStrategy: PID 12586 died... 02:14:24.516015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12586): Terminated: ok {rc=0} 02:14:24.561006 --- ParallelTerminationStrategy: PID 12589 died... 02:14:24.579862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12589): Terminated: ok {rc=0} 02:14:24.667704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:14:25.822017 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:25.834326 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:25.875198 tst iperf3m4.py: using LAC 25279 02:14:26.008933 tst iperf3m4.py: using RAC 34 02:14:26.141050 tst iperf3m4.py: using CellId 25279 02:14:26.272889 tst iperf3m4.py: using BVCI 25280 02:14:26.396085 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.407434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.418772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.430156 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.441477 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.452734 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.464289 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.475539 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:26.487016 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:26.611323 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:26.731327 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:26.855265 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:26.976601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:27.205093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:27.547048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12591): Launched 02:14:27.841582 run iperf3-srv_10.42.42.10(pid=12592): Launched 02:14:27.968518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:14:28.196625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:28.537920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Launched 02:14:28.834988 run iperf3-srv_10.42.42.10(pid=12594): Launched 02:14:28.961377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:14:29.187721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:29.527655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Launched 02:14:29.821023 run iperf3-srv_10.42.42.10(pid=12596): Launched 02:14:29.947321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:14:30.173842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:30.513724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12597): Launched 02:14:30.808070 run iperf3-srv_10.42.42.10(pid=12598): Launched 02:14:30.937622 tst iperf3m4.py:8: start network... 02:14:31.175031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:31.711693 run create_hlr_db(pid=12599): Launched 02:14:31.879658 bus /gobi_6: Setting Powered False 02:14:32.945122 run create_hlr_db(pid=12599): Terminated: ok {rc=0} 02:14:33.413610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Launched 02:14:33.751077 run osmo-hlr_10.42.42.2(pid=12602): Launched 02:14:33.879610 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:34.465244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Launched 02:14:34.803393 run osmo-stp_10.42.42.5(pid=12605): Launched 02:14:34.932197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:35.513671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Launched 02:14:35.642440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:35.928868 run patchelf(pid=12608): Launched 02:14:36.115855 run osmo-stp_10.42.42.5(pid=12605): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] 02:14:36.257515 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-10_02:14:34.739704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:36.400529 run osmo-stp_10.42.42.5(pid=12605): stderr: | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021434936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:36.543298 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-10_02:14:34.739704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:36.681074 run osmo-stp_10.42.42.5(pid=12605): stderr: | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021434935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021434936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021434938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:36.844225 run patchelf(pid=12608): Terminating (SIGINT) 02:14:37.032759 run patchelf(pid=12608): Terminated: ok {rc=0} 02:14:37.167988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 02:14:37.178346 tst iperf3m4.py:8: Test FAILED (11.4 sec) 02:14:37.207377 run osmo-hlr_10.42.42.2(pid=12602): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12602)] 02:14:37.258656 run osmo-hlr_10.42.42.2(pid=12602): stdout: | (launched: 2022-12-10_02:14:33.688017) 02:14:37.311776 run osmo-hlr_10.42.42.2(pid=12602): stderr: | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021433892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021433905 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021433913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021433913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021433914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:37.365634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12591): Terminating (SIGTERM) 02:14:37.408025 run iperf3-srv_10.42.42.10(pid=12592): Terminating (SIGTERM) 02:14:37.450480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminating (SIGTERM) 02:14:37.492928 run iperf3-srv_10.42.42.10(pid=12594): Terminating (SIGTERM) 02:14:37.535302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Terminating (SIGTERM) 02:14:37.577577 run iperf3-srv_10.42.42.10(pid=12596): Terminating (SIGTERM) 02:14:37.619781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12597): Terminating (SIGTERM) 02:14:37.662241 run iperf3-srv_10.42.42.10(pid=12598): Terminating (SIGTERM) 02:14:37.704434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminating (SIGTERM) 02:14:37.747196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminating (SIGTERM) 02:14:37.789757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Terminating (SIGTERM) 02:14:37.832399 --- ParallelTerminationStrategy: PID 12591 died... 02:14:37.852826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12591): Terminated: ok {rc=0} 02:14:37.899936 --- ParallelTerminationStrategy: PID 12592 died... 02:14:37.919839 run iperf3-srv_10.42.42.10(pid=12592): Terminated {rc=256} 02:14:37.966418 --- ParallelTerminationStrategy: PID 12593 died... 02:14:37.986403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminated: ok {rc=0} 02:14:38.033135 --- ParallelTerminationStrategy: PID 12594 died... 02:14:38.053130 run iperf3-srv_10.42.42.10(pid=12594): Terminated {rc=256} 02:14:38.099752 --- ParallelTerminationStrategy: PID 12595 died... 02:14:38.119709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Terminated: ok {rc=0} 02:14:38.167226 --- ParallelTerminationStrategy: PID 12596 died... 02:14:38.187319 run iperf3-srv_10.42.42.10(pid=12596): Terminated {rc=256} 02:14:38.234194 --- ParallelTerminationStrategy: PID 12597 died... 02:14:38.254542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12597): Terminated: ok {rc=0} 02:14:38.301464 --- ParallelTerminationStrategy: PID 12598 died... 02:14:38.321606 run iperf3-srv_10.42.42.10(pid=12598): Terminated {rc=256} 02:14:38.368535 --- ParallelTerminationStrategy: PID 12601 died... 02:14:38.388680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminated: ok {rc=0} 02:14:38.435572 --- ParallelTerminationStrategy: PID 12604 died... 02:14:38.455724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminated: ok {rc=0} 02:14:38.502557 --- ParallelTerminationStrategy: PID 12607 died... 02:14:38.522634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12607): Terminated: ok {rc=0} 02:14:38.611135 bus /gobi_4: Setting Powered False 02:14:39.711857 bus /gobi_4: Setting Powered False 02:14:40.828191 bus /gobi_1: Setting Powered False 02:14:41.925796 bus /gobi_1: Setting Powered False 02:14:43.040010 bus /gobi_0: Setting Powered False 02:14:44.141208 bus /gobi_0: Setting Powered False 02:14:45.262171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 02:14:46.375612 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:46.388133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:46.427673 tst ping.py: using LAC 25280 02:14:46.553854 tst ping.py: using RAC 35 02:14:46.688182 tst ping.py: using CellId 25280 02:14:46.842067 tst ping.py: using BVCI 25281 02:14:46.983893 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:46.995913 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.009223 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.020881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.032637 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.044667 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.060599 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:47.073616 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:47.198156 tst ping.py:19: start network... 02:14:47.416066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:47.895394 run create_hlr_db(pid=12610): Launched 02:14:48.012517 bus /gobi_6: Setting Powered False 02:14:49.074382 run create_hlr_db(pid=12610): Terminated: ok {rc=0} 02:14:49.528050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Launched 02:14:49.859221 run osmo-hlr_10.42.42.2(pid=12613): Launched 02:14:49.984286 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:50.553231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Launched 02:14:50.883210 run osmo-stp_10.42.42.5(pid=12616): Launched 02:14:51.008165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:51.576548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Launched 02:14:51.702488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:51.982483 run patchelf(pid=12619): Launched 02:14:52.166042 run osmo-stp_10.42.42.5(pid=12616): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] 02:14:52.305639 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-10_02:14:50.821507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:52.446776 run osmo-stp_10.42.42.5(pid=12616): stderr: | [0;m[38;5;43m20221210021451016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021451017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021451017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021451017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:52.588096 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-10_02:14:50.821507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:52.724007 run osmo-stp_10.42.42.5(pid=12616): stderr: | [0;m[38;5;43m20221210021451016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021451017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021451017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021451017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021451018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:52.884223 run patchelf(pid=12619): Terminating (SIGINT) 02:14:53.069236 run patchelf(pid=12619): Terminated: ok {rc=0} 02:14:53.201900 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 02:14:53.211479 tst ping.py:22: Test FAILED (6.8 sec) 02:14:53.239858 run osmo-hlr_10.42.42.2(pid=12613): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12613)] 02:14:53.290591 run osmo-hlr_10.42.42.2(pid=12613): stdout: | (launched: 2022-12-10_02:14:49.797387) 02:14:53.342906 run osmo-hlr_10.42.42.2(pid=12613): stderr: | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021450000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021450016 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021450026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021450026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021450026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:53.395368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminating (SIGTERM) 02:14:53.437283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminating (SIGTERM) 02:14:53.479265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Terminating (SIGTERM) 02:14:53.521469 --- ParallelTerminationStrategy: PID 12612 died... 02:14:53.541715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminated: ok {rc=0} 02:14:53.588151 --- ParallelTerminationStrategy: PID 12615 died... 02:14:53.607681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminated: ok {rc=0} 02:14:53.654233 --- ParallelTerminationStrategy: PID 12618 died... 02:14:53.674027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12618): Terminated: ok {rc=0} 02:14:53.762666 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:14:54.851074 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.863219 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:54.906283 tst ping_idle_ping.py: using LAC 25281 02:14:55.034735 tst ping_idle_ping.py: using RAC 36 02:14:55.162339 tst ping_idle_ping.py: using CellId 25281 02:14:55.290606 tst ping_idle_ping.py: using BVCI 25282 02:14:55.410397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.421845 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.433088 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.444248 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.455414 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.466611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.477911 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:55.489405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:55.613956 tst ping_idle_ping.py:24: start network... 02:14:55.820883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:56.298491 run create_hlr_db(pid=12620): Launched 02:14:56.417131 bus /gobi_6: Setting Powered False 02:14:57.478907 run create_hlr_db(pid=12620): Terminated: ok {rc=0} 02:14:57.931859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Launched 02:14:58.264206 run osmo-hlr_10.42.42.2(pid=12623): Launched 02:14:58.390832 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:58.963289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Launched 02:14:59.296444 run osmo-stp_10.42.42.5(pid=12626): Launched 02:14:59.422617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:59.997220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Launched 02:15:00.123698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:00.404562 run patchelf(pid=12629): Launched 02:15:00.587989 run osmo-stp_10.42.42.5(pid=12626): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] 02:15:00.727207 run osmo-stp_10.42.42.5(pid=12626): stdout: | (launched: 2022-12-10_02:14:59.233941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:00.890198 run osmo-stp_10.42.42.5(pid=12626): stderr: | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021459431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:01.032007 run osmo-stp_10.42.42.5(pid=12626): stdout: | (launched: 2022-12-10_02:14:59.233941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:01.167940 run osmo-stp_10.42.42.5(pid=12626): stderr: | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021459431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021459431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021459432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:01.325182 run patchelf(pid=12629): Terminating (SIGINT) 02:15:01.503761 run patchelf(pid=12629): Terminated: ok {rc=0} 02:15:01.643117 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12626): Process ended prematurely: osmo-stp_10.42.42.5(pid=12626) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 02:15:01.654020 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 02:15:01.685098 run osmo-hlr_10.42.42.2(pid=12623): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12623)] 02:15:01.736294 run osmo-hlr_10.42.42.2(pid=12623): stdout: | (launched: 2022-12-10_02:14:58.202039) 02:15:01.790060 run osmo-hlr_10.42.42.2(pid=12623): stderr: | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021458402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021458414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021458423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021458423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021458423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:01.844763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Terminating (SIGTERM) 02:15:01.888063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Terminating (SIGTERM) 02:15:01.933015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Terminating (SIGTERM) 02:15:01.978514 --- ParallelTerminationStrategy: PID 12622 died... 02:15:01.999813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12622): Terminated: ok {rc=0} 02:15:02.049864 --- ParallelTerminationStrategy: PID 12625 died... 02:15:02.069701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12625): Terminated: ok {rc=0} 02:15:02.119342 --- ParallelTerminationStrategy: PID 12628 died... 02:15:02.139240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12628): Terminated: ok {rc=0} 02:15:02.231369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:15:03.523855 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:15:03.530267 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:15:03.551790 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:15:03.591610 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:15:03.683337 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:15:03.705272 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:15:03.745455 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:15:04.340012 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:15:04.393777 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:04.405134 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:04.463030 tst cs_paging_gprs_active.py: using LAC 25282 02:15:04.595585 tst cs_paging_gprs_active.py: using RAC 37 02:15:04.726386 tst cs_paging_gprs_active.py: using CellId 25282 02:15:04.857803 tst cs_paging_gprs_active.py: using BVCI 25283 02:15:04.981032 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:04.992541 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.003803 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.015026 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.026174 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.037381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.048717 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.059794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:05.071196 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:05.192194 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:05.313846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:15:05.526380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:05.844011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12638): Launched 02:15:06.119168 run iperf3-srv_10.42.42.10(pid=12639): Launched 02:15:06.238011 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:15:06.449199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:06.766311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12640): Launched 02:15:07.040426 run iperf3-srv_10.42.42.10(pid=12641): Launched 02:15:07.159028 tst cs_paging_gprs_active.py:38: start network... 02:15:07.368793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:07.857221 run create_hlr_db(pid=12642): Launched 02:15:07.977691 bus /gobi_6: Setting Powered False 02:15:09.039787 run create_hlr_db(pid=12642): Terminated: ok {rc=0} 02:15:09.500693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12644): Launched 02:15:09.839760 run osmo-hlr_10.42.42.2(pid=12645): Launched 02:15:09.968677 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:10.551298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12647): Launched 02:15:10.889303 run osmo-stp_10.42.42.5(pid=12648): Launched 02:15:11.018265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:11.600873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12650): Launched 02:15:11.729248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:12.015061 run patchelf(pid=12651): Launched 02:15:12.201538 run osmo-stp_10.42.42.5(pid=12648): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12648)] 02:15:12.344085 run osmo-stp_10.42.42.5(pid=12648): stdout: | (launched: 2022-12-10_02:15:10.826089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:12.487879 run osmo-stp_10.42.42.5(pid=12648): stderr: | [0;m[38;5;43m20221210021511024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021511024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021511025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021511025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:12.631877 run osmo-stp_10.42.42.5(pid=12648): stdout: | (launched: 2022-12-10_02:15:10.826089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:12.769753 run osmo-stp_10.42.42.5(pid=12648): stderr: | [0;m[38;5;43m20221210021511024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021511024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021511025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021511025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021511026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:12.932929 run patchelf(pid=12651): Terminating (SIGINT) 02:15:13.121532 run patchelf(pid=12651): Terminated: ok {rc=0} 02:15:13.258342 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12648): Process ended prematurely: osmo-stp_10.42.42.5(pid=12648) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12648)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:15:13.268513 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:15:13.297410 run osmo-hlr_10.42.42.2(pid=12645): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12645)] 02:15:13.348109 run osmo-hlr_10.42.42.2(pid=12645): stdout: | (launched: 2022-12-10_02:15:09.776449) 02:15:13.400224 run osmo-hlr_10.42.42.2(pid=12645): stderr: | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021509978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021509990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021509999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021509999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021509999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:13.452733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12638): Terminating (SIGTERM) 02:15:13.494924 run iperf3-srv_10.42.42.10(pid=12639): Terminating (SIGTERM) 02:15:13.536768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12640): Terminating (SIGTERM) 02:15:13.579567 run iperf3-srv_10.42.42.10(pid=12641): Terminating (SIGTERM) 02:15:13.622151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12644): Terminating (SIGTERM) 02:15:13.664495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12647): Terminating (SIGTERM) 02:15:13.706960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12650): Terminating (SIGTERM) 02:15:13.749479 --- ParallelTerminationStrategy: PID 12638 died... 02:15:13.769711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12638): Terminated: ok {rc=0} 02:15:13.816525 --- ParallelTerminationStrategy: PID 12639 died... 02:15:13.836341 run iperf3-srv_10.42.42.10(pid=12639): Terminated {rc=256} 02:15:13.882528 --- ParallelTerminationStrategy: PID 12640 died... 02:15:13.902611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12640): Terminated: ok {rc=0} 02:15:13.948791 --- ParallelTerminationStrategy: PID 12641 died... 02:15:13.968845 run iperf3-srv_10.42.42.10(pid=12641): Terminated {rc=256} 02:15:14.015445 --- ParallelTerminationStrategy: PID 12644 died... 02:15:14.035106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12644): Terminated: ok {rc=0} 02:15:14.081452 --- ParallelTerminationStrategy: PID 12647 died... 02:15:14.101190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12647): Terminated: ok {rc=0} 02:15:14.147598 --- ParallelTerminationStrategy: PID 12650 died... 02:15:14.167232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12650): Terminated: ok {rc=0} 02:15:14.255914 bus /gobi_0: Setting Powered False 02:15:15.356583 bus /gobi_0: Setting Powered False 02:15:16.495803 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:15:17.649901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:17.662170 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:17.724723 tst iperf3.py: using LAC 25283 02:15:17.861163 tst iperf3.py: using RAC 38 02:15:17.991888 tst iperf3.py: using CellId 25283 02:15:18.121314 tst iperf3.py: using BVCI 25284 02:15:18.243089 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.254659 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.266320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.277752 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.288785 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.300083 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.311674 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.323037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:18.334426 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:18.455294 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:18.682822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:19.021978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12652): Launched 02:15:19.317684 run iperf3-srv_10.42.42.10(pid=12653): Launched 02:15:19.444395 tst iperf3.py:8: start network... 02:15:19.671341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:20.194699 run create_hlr_db(pid=12654): Launched 02:15:20.331437 bus /gobi_6: Setting Powered False 02:15:21.397271 run create_hlr_db(pid=12654): Terminated: ok {rc=0} 02:15:21.864741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Launched 02:15:22.202938 run osmo-hlr_10.42.42.2(pid=12657): Launched 02:15:22.331266 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:22.911701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Launched 02:15:23.248587 run osmo-stp_10.42.42.5(pid=12660): Launched 02:15:23.377332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:23.958847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12662): Launched 02:15:24.086427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:24.372080 run patchelf(pid=12663): Launched 02:15:24.558333 run osmo-stp_10.42.42.5(pid=12660): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] 02:15:24.699975 run osmo-stp_10.42.42.5(pid=12660): stdout: | (launched: 2022-12-10_02:15:23.185856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:24.842553 run osmo-stp_10.42.42.5(pid=12660): stderr: | [0;m[38;5;43m20221210021523380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021523380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021523381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021523381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021523384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021523384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021523385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:24.985678 run osmo-stp_10.42.42.5(pid=12660): stdout: | (launched: 2022-12-10_02:15:23.185856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:25.123114 run osmo-stp_10.42.42.5(pid=12660): stderr: | [0;m[38;5;43m20221210021523380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021523380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021523381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021523381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021523384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021523384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021523385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:25.287307 run patchelf(pid=12663): Terminating (SIGINT) 02:15:25.474975 run patchelf(pid=12663): Terminated: ok {rc=0} 02:15:25.609567 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12660): Process ended prematurely: osmo-stp_10.42.42.5(pid=12660) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 02:15:25.619651 tst iperf3.py:8: Test FAILED (8.0 sec) 02:15:25.648349 run osmo-hlr_10.42.42.2(pid=12657): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12657)] 02:15:25.698882 run osmo-hlr_10.42.42.2(pid=12657): stdout: | (launched: 2022-12-10_02:15:22.139606) 02:15:25.750883 run osmo-hlr_10.42.42.2(pid=12657): stderr: | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021522344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021522357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021522365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021522365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021522365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:25.803233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12652): Terminating (SIGTERM) 02:15:25.845175 run iperf3-srv_10.42.42.10(pid=12653): Terminating (SIGTERM) 02:15:25.887305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Terminating (SIGTERM) 02:15:25.929554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Terminating (SIGTERM) 02:15:25.971386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12662): Terminating (SIGTERM) 02:15:26.013713 --- ParallelTerminationStrategy: PID 12652 died... 02:15:26.033957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12652): Terminated: ok {rc=0} 02:15:26.080205 --- ParallelTerminationStrategy: PID 12653 died... 02:15:26.099988 run iperf3-srv_10.42.42.10(pid=12653): Terminated {rc=256} 02:15:26.146136 --- ParallelTerminationStrategy: PID 12656 died... 02:15:26.165817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12656): Terminated: ok {rc=0} 02:15:26.211904 --- ParallelTerminationStrategy: PID 12659 died... 02:15:26.231509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12659): Terminated: ok {rc=0} 02:15:26.278090 --- ParallelTerminationStrategy: PID 12662 died... 02:15:26.297878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12662): Terminated: ok {rc=0} 02:15:26.387361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:15:27.542691 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:27.554811 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:27.614621 tst iperf3m4.py: using LAC 25284 02:15:27.747718 tst iperf3m4.py: using RAC 39 02:15:27.879986 tst iperf3m4.py: using CellId 25284 02:15:28.013031 tst iperf3m4.py: using BVCI 25285 02:15:28.134758 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.146307 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.157578 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.168800 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.179978 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.191232 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.202656 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.213799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:28.225206 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:28.348842 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:28.471784 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:28.591206 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:28.714744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:28.926955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:29.246227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Launched 02:15:29.523420 run iperf3-srv_10.42.42.10(pid=12665): Launched 02:15:29.642402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:15:29.853704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:30.172326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12666): Launched 02:15:30.448611 run iperf3-srv_10.42.42.10(pid=12667): Launched 02:15:30.567225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:15:30.777480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:31.128861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12668): Launched 02:15:31.444064 run iperf3-srv_10.42.42.10(pid=12669): Launched 02:15:31.588196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:15:31.823131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:32.227289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12670): Launched 02:15:32.531797 run iperf3-srv_10.42.42.10(pid=12671): Launched 02:15:32.660575 tst iperf3m4.py:8: start network... 02:15:32.887540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:33.412931 run create_hlr_db(pid=12672): Launched 02:15:33.549234 bus /gobi_6: Setting Powered False 02:15:34.614640 run create_hlr_db(pid=12672): Terminated: ok {rc=0} 02:15:35.081939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12674): Launched 02:15:35.421015 run osmo-hlr_10.42.42.2(pid=12675): Launched 02:15:35.548127 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:36.127798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12677): Launched 02:15:36.465160 run osmo-stp_10.42.42.5(pid=12678): Launched 02:15:36.592618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:37.170812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12680): Launched 02:15:37.300512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:37.585966 run patchelf(pid=12681): Launched 02:15:37.771665 run osmo-stp_10.42.42.5(pid=12678): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12678)] 02:15:37.912601 run osmo-stp_10.42.42.5(pid=12678): stdout: | (launched: 2022-12-10_02:15:36.402135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:38.054802 run osmo-stp_10.42.42.5(pid=12678): stderr: | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021536599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:38.197355 run osmo-stp_10.42.42.5(pid=12678): stdout: | (launched: 2022-12-10_02:15:36.402135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:38.334860 run osmo-stp_10.42.42.5(pid=12678): stderr: | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021536598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021536599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021536599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:38.496915 run patchelf(pid=12681): Terminating (SIGINT) 02:15:38.683398 run patchelf(pid=12681): Terminated: ok {rc=0} 02:15:38.818572 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12678): Process ended prematurely: osmo-stp_10.42.42.5(pid=12678) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12678)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:15:38.828641 tst iperf3m4.py:8: Test FAILED (11.3 sec) 02:15:38.857481 run osmo-hlr_10.42.42.2(pid=12675): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12675)] 02:15:38.908028 run osmo-hlr_10.42.42.2(pid=12675): stdout: | (launched: 2022-12-10_02:15:35.357729) 02:15:38.960374 run osmo-hlr_10.42.42.2(pid=12675): stderr: | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021535561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021535574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021535583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021535583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021535583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:39.013150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Terminating (SIGTERM) 02:15:39.055542 run iperf3-srv_10.42.42.10(pid=12665): Terminating (SIGTERM) 02:15:39.098022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12666): Terminating (SIGTERM) 02:15:39.140619 run iperf3-srv_10.42.42.10(pid=12667): Terminating (SIGTERM) 02:15:39.183263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12668): Terminating (SIGTERM) 02:15:39.226010 run iperf3-srv_10.42.42.10(pid=12669): Terminating (SIGTERM) 02:15:39.268829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12670): Terminating (SIGTERM) 02:15:39.311536 run iperf3-srv_10.42.42.10(pid=12671): Terminating (SIGTERM) 02:15:39.354100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12674): Terminating (SIGTERM) 02:15:39.397212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12677): Terminating (SIGTERM) 02:15:39.439447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12680): Terminating (SIGTERM) 02:15:39.482410 --- ParallelTerminationStrategy: PID 12664 died... 02:15:39.502889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Terminated: ok {rc=0} 02:15:39.550156 --- ParallelTerminationStrategy: PID 12665 died... 02:15:39.570004 run iperf3-srv_10.42.42.10(pid=12665): Terminated {rc=256} 02:15:39.616874 --- ParallelTerminationStrategy: PID 12666 died... 02:15:39.637378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12666): Terminated: ok {rc=0} 02:15:39.684224 --- ParallelTerminationStrategy: PID 12667 died... 02:15:39.704169 run iperf3-srv_10.42.42.10(pid=12667): Terminated {rc=256} 02:15:39.750783 --- ParallelTerminationStrategy: PID 12668 died... 02:15:39.770788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12668): Terminated: ok {rc=0} 02:15:39.817653 --- ParallelTerminationStrategy: PID 12669 died... 02:15:39.837608 run iperf3-srv_10.42.42.10(pid=12669): Terminated {rc=256} 02:15:39.884411 --- ParallelTerminationStrategy: PID 12670 died... 02:15:39.904452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12670): Terminated: ok {rc=0} 02:15:39.951482 --- ParallelTerminationStrategy: PID 12671 died... 02:15:39.971371 run iperf3-srv_10.42.42.10(pid=12671): Terminated {rc=256} 02:15:40.018441 --- ParallelTerminationStrategy: PID 12674 died... 02:15:40.038601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12674): Terminated: ok {rc=0} 02:15:40.085529 --- ParallelTerminationStrategy: PID 12677 died... 02:15:40.105668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12677): Terminated: ok {rc=0} 02:15:40.152656 --- ParallelTerminationStrategy: PID 12680 died... 02:15:40.172752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12680): Terminated: ok {rc=0} 02:15:40.262549 bus /gobi_4: Setting Powered False 02:15:41.364048 bus /gobi_4: Setting Powered False 02:15:42.483369 bus /gobi_1: Setting Powered False 02:15:43.584036 bus /gobi_1: Setting Powered False 02:15:44.701187 bus /gobi_0: Setting Powered False 02:15:45.800753 bus /gobi_0: Setting Powered False 02:15:46.939895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:15:48.047791 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.059763 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:48.117836 tst ping.py: using LAC 25285 02:15:48.247668 tst ping.py: using RAC 40 02:15:48.382915 tst ping.py: using CellId 25285 02:15:48.516809 tst ping.py: using BVCI 25286 02:15:48.638063 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.649608 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.660694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.672086 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.683299 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.694489 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.705935 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:48.717157 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:48.834886 tst ping.py:19: start network... 02:15:49.043123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:49.522860 run create_hlr_db(pid=12682): Launched 02:15:49.641545 bus /gobi_6: Setting Powered False 02:15:50.703361 run create_hlr_db(pid=12682): Terminated: ok {rc=0} 02:15:51.156800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Launched 02:15:51.489180 run osmo-hlr_10.42.42.2(pid=12685): Launched 02:15:51.614633 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:52.196266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Launched 02:15:52.527986 run osmo-stp_10.42.42.5(pid=12688): Launched 02:15:52.652402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:53.223129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Launched 02:15:53.349440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:53.629605 run patchelf(pid=12691): Launched 02:15:53.812815 run osmo-stp_10.42.42.5(pid=12688): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] 02:15:53.951693 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-10_02:15:52.465903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:54.092239 run osmo-stp_10.42.42.5(pid=12688): stderr: | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021552664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:54.234366 run osmo-stp_10.42.42.5(pid=12688): stdout: | (launched: 2022-12-10_02:15:52.465903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:54.369464 run osmo-stp_10.42.42.5(pid=12688): stderr: | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021552663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021552664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021552664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:54.528849 run patchelf(pid=12691): Terminating (SIGINT) 02:15:54.713122 run patchelf(pid=12691): Terminated: ok {rc=0} 02:15:54.845449 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 02:15:54.854825 tst ping.py:22: Test FAILED (6.8 sec) 02:15:54.883079 run osmo-hlr_10.42.42.2(pid=12685): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12685)] 02:15:54.933832 run osmo-hlr_10.42.42.2(pid=12685): stdout: | (launched: 2022-12-10_02:15:51.427067) 02:15:54.986248 run osmo-hlr_10.42.42.2(pid=12685): stderr: | [0;m[1;31m20221210021551627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021551627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021551628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021551628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021551628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021551628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021551641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021551651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021551651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021551651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:55.038802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminating (SIGTERM) 02:15:55.081096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminating (SIGTERM) 02:15:55.123265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Terminating (SIGTERM) 02:15:55.165790 --- ParallelTerminationStrategy: PID 12684 died... 02:15:55.185961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12684): Terminated: ok {rc=0} 02:15:55.232487 --- ParallelTerminationStrategy: PID 12687 died... 02:15:55.252185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12687): Terminated: ok {rc=0} 02:15:55.299119 --- ParallelTerminationStrategy: PID 12690 died... 02:15:55.318888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12690): Terminated: ok {rc=0} 02:15:55.407870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:15:56.496554 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:56.508687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:56.566952 tst ping_idle_ping.py: using LAC 25286 02:15:56.690831 tst ping_idle_ping.py: using RAC 41 02:15:56.814756 tst ping_idle_ping.py: using CellId 25286 02:15:56.937429 tst ping_idle_ping.py: using BVCI 25287 02:15:57.058378 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.069878 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.081195 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.092333 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.103858 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.115109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.126548 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:57.137778 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:57.259201 tst ping_idle_ping.py:24: start network... 02:15:57.482825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:57.999963 run create_hlr_db(pid=12692): Launched 02:15:58.134599 bus /gobi_6: Setting Powered False 02:15:59.199760 run create_hlr_db(pid=12692): Terminated: ok {rc=0} 02:15:59.646023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Launched 02:15:59.960028 run osmo-hlr_10.42.42.2(pid=12695): Launched 02:16:00.079443 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:00.635618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Launched 02:16:00.978722 run osmo-stp_10.42.42.5(pid=12698): Launched 02:16:01.288631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:02.026361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Launched 02:16:02.168183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:02.455302 run patchelf(pid=12701): Launched 02:16:02.640048 run osmo-stp_10.42.42.5(pid=12698): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] 02:16:02.780109 run osmo-stp_10.42.42.5(pid=12698): stdout: | (launched: 2022-12-10_02:16:00.916307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:02.921369 run osmo-stp_10.42.42.5(pid=12698): stderr: | [0;m[38;5;43m20221210021601246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021601246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021601248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021601249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021601251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021601252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021601252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:03.063126 run osmo-stp_10.42.42.5(pid=12698): stdout: | (launched: 2022-12-10_02:16:00.916307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:03.199088 run osmo-stp_10.42.42.5(pid=12698): stderr: | [0;m[38;5;43m20221210021601246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021601246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021601248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021601249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021601251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021601252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021601252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:03.360431 run patchelf(pid=12701): Terminating (SIGINT) 02:16:03.546113 run patchelf(pid=12701): Terminated: ok {rc=0} 02:16:03.680288 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12698): Process ended prematurely: osmo-stp_10.42.42.5(pid=12698) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:16:03.689775 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 02:16:03.718380 run osmo-hlr_10.42.42.2(pid=12695): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12695)] 02:16:03.769578 run osmo-hlr_10.42.42.2(pid=12695): stdout: | (launched: 2022-12-10_02:15:59.901320) 02:16:03.822488 run osmo-hlr_10.42.42.2(pid=12695): stderr: | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021600080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021600092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021600100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021600101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021600101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:03.875683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Terminating (SIGTERM) 02:16:03.918123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Terminating (SIGTERM) 02:16:03.960625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Terminating (SIGTERM) 02:16:04.003386 --- ParallelTerminationStrategy: PID 12694 died... 02:16:04.023604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12694): Terminated: ok {rc=0} 02:16:04.070073 --- ParallelTerminationStrategy: PID 12697 died... 02:16:04.089866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12697): Terminated: ok {rc=0} 02:16:04.136535 --- ParallelTerminationStrategy: PID 12700 died... 02:16:04.156287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12700): Terminated: ok {rc=0} 02:16:04.245043 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:16:05.538967 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:16:05.545875 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:16:05.567754 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:16:05.609729 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:16:05.697554 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:16:05.718368 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:16:05.757474 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:16:06.350021 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:16:06.400850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:06.411764 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:06.468554 tst cs_paging_gprs_active.py: using LAC 25287 02:16:06.593275 tst cs_paging_gprs_active.py: using RAC 42 02:16:06.721857 tst cs_paging_gprs_active.py: using CellId 25287 02:16:06.849524 tst cs_paging_gprs_active.py: using BVCI 25288 02:16:06.966104 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:06.976923 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:06.987747 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:06.998930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:07.009877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:07.020751 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:07.031876 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:07.042737 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:07.053876 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:07.176457 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:07.297298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:16:07.508710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:07.826346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12708): Launched 02:16:08.101100 run iperf3-srv_10.42.42.10(pid=12709): Launched 02:16:08.219244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:16:08.428894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:08.745513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12710): Launched 02:16:09.019249 run iperf3-srv_10.42.42.10(pid=12711): Launched 02:16:09.137515 tst cs_paging_gprs_active.py:38: start network... 02:16:09.348022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:09.836477 run create_hlr_db(pid=12712): Launched 02:16:09.956829 bus /gobi_6: Setting Powered False 02:16:11.019472 run create_hlr_db(pid=12712): Terminated: ok {rc=0} 02:16:11.457897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Launched 02:16:11.774992 run osmo-hlr_10.42.42.2(pid=12715): Launched 02:16:11.896246 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:12.456617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Launched 02:16:12.772107 run osmo-stp_10.42.42.5(pid=12718): Launched 02:16:12.893449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:13.436121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12720): Launched 02:16:13.556548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:13.824565 run patchelf(pid=12721): Launched 02:16:13.999309 run osmo-stp_10.42.42.5(pid=12718): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] 02:16:14.132690 run osmo-stp_10.42.42.5(pid=12718): stdout: | (launched: 2022-12-10_02:16:12.712448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:14.267142 run osmo-stp_10.42.42.5(pid=12718): stderr: | [0;m[38;5;43m20221210021612887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021612887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021612888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021612888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021612888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021612889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021612889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:14.401553 run osmo-stp_10.42.42.5(pid=12718): stdout: | (launched: 2022-12-10_02:16:12.712448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:14.530258 run osmo-stp_10.42.42.5(pid=12718): stderr: | [0;m[38;5;43m20221210021612887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021612887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021612888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021612888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021612888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021612889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021612889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:14.683145 run patchelf(pid=12721): Terminating (SIGINT) 02:16:14.859333 run patchelf(pid=12721): Terminated: ok {rc=0} 02:16:14.986246 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12718): Process ended prematurely: osmo-stp_10.42.42.5(pid=12718) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:16:14.995701 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:16:15.023574 run osmo-hlr_10.42.42.2(pid=12715): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12715)] 02:16:15.072269 run osmo-hlr_10.42.42.2(pid=12715): stdout: | (launched: 2022-12-10_02:16:11.715305) 02:16:15.122753 run osmo-hlr_10.42.42.2(pid=12715): stderr: | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021611895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021611907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021611917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021611917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021611918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:15.173588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12708): Terminating (SIGTERM) 02:16:15.214146 run iperf3-srv_10.42.42.10(pid=12709): Terminating (SIGTERM) 02:16:15.254408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12710): Terminating (SIGTERM) 02:16:15.294805 run iperf3-srv_10.42.42.10(pid=12711): Terminating (SIGTERM) 02:16:15.334923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Terminating (SIGTERM) 02:16:15.375326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Terminating (SIGTERM) 02:16:15.415856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12720): Terminating (SIGTERM) 02:16:15.456415 --- ParallelTerminationStrategy: PID 12708 died... 02:16:15.475671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12708): Terminated: ok {rc=0} 02:16:15.520399 --- ParallelTerminationStrategy: PID 12709 died... 02:16:15.539081 run iperf3-srv_10.42.42.10(pid=12709): Terminated {rc=256} 02:16:15.583560 --- ParallelTerminationStrategy: PID 12710 died... 02:16:15.602281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12710): Terminated: ok {rc=0} 02:16:15.647322 --- ParallelTerminationStrategy: PID 12711 died... 02:16:15.666231 run iperf3-srv_10.42.42.10(pid=12711): Terminated {rc=256} 02:16:15.710893 --- ParallelTerminationStrategy: PID 12714 died... 02:16:15.729639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Terminated: ok {rc=0} 02:16:15.774683 --- ParallelTerminationStrategy: PID 12717 died... 02:16:15.793478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Terminated: ok {rc=0} 02:16:15.843343 --- ParallelTerminationStrategy: PID 12720 died... 02:16:15.871361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12720): Terminated: ok {rc=0} 02:16:15.961963 bus /gobi_0: Setting Powered False 02:16:17.062195 bus /gobi_0: Setting Powered False 02:16:18.180074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:16:19.331672 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.343897 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:19.405747 tst iperf3.py: using LAC 25288 02:16:19.537961 tst iperf3.py: using RAC 43 02:16:19.670481 tst iperf3.py: using CellId 25288 02:16:19.802233 tst iperf3.py: using BVCI 25289 02:16:19.926360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.937984 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.949297 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.960571 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.971915 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.983196 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:19.994615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:20.005801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:20.017283 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:20.136544 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:20.350326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:20.669467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Launched 02:16:20.946983 run iperf3-srv_10.42.42.10(pid=12723): Launched 02:16:21.065879 tst iperf3.py:8: start network... 02:16:21.277253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:21.768509 run create_hlr_db(pid=12724): Launched 02:16:21.889886 bus /gobi_6: Setting Powered False 02:16:22.952270 run create_hlr_db(pid=12724): Terminated: ok {rc=0} 02:16:23.412802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12726): Launched 02:16:23.751170 run osmo-hlr_10.42.42.2(pid=12727): Launched 02:16:23.878794 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:24.461424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12729): Launched 02:16:24.800513 run osmo-stp_10.42.42.5(pid=12730): Launched 02:16:24.930029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:25.512312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12732): Launched 02:16:25.640651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:25.926475 run patchelf(pid=12733): Launched 02:16:26.112468 run osmo-stp_10.42.42.5(pid=12730): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12730)] 02:16:26.253896 run osmo-stp_10.42.42.5(pid=12730): stdout: | (launched: 2022-12-10_02:16:24.736215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:26.397594 run osmo-stp_10.42.42.5(pid=12730): stderr: | [0;m[38;5;43m20221210021624935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021624935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021624936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:26.540732 run osmo-stp_10.42.42.5(pid=12730): stdout: | (launched: 2022-12-10_02:16:24.736215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:26.678286 run osmo-stp_10.42.42.5(pid=12730): stderr: | [0;m[38;5;43m20221210021624935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021624935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021624936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021624937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:26.841138 run patchelf(pid=12733): Terminating (SIGINT) 02:16:27.029156 run patchelf(pid=12733): Terminated: ok {rc=0} 02:16:27.164280 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12730): Process ended prematurely: osmo-stp_10.42.42.5(pid=12730) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12730)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 02:16:27.174532 tst iperf3.py:8: Test FAILED (7.9 sec) 02:16:27.203384 run osmo-hlr_10.42.42.2(pid=12727): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12727)] 02:16:27.254334 run osmo-hlr_10.42.42.2(pid=12727): stdout: | (launched: 2022-12-10_02:16:23.687740) 02:16:27.307417 run osmo-hlr_10.42.42.2(pid=12727): stderr: | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021623893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021623905 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021623914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021623914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021623914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:27.360592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Terminating (SIGTERM) 02:16:27.403072 run iperf3-srv_10.42.42.10(pid=12723): Terminating (SIGTERM) 02:16:27.445489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12726): Terminating (SIGTERM) 02:16:27.488166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12729): Terminating (SIGTERM) 02:16:27.530582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12732): Terminating (SIGTERM) 02:16:27.573292 --- ParallelTerminationStrategy: PID 12722 died... 02:16:27.593627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Terminated: ok {rc=0} 02:16:27.640628 --- ParallelTerminationStrategy: PID 12723 died... 02:16:27.660586 run iperf3-srv_10.42.42.10(pid=12723): Terminated {rc=256} 02:16:27.707406 --- ParallelTerminationStrategy: PID 12726 died... 02:16:27.727330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12726): Terminated: ok {rc=0} 02:16:27.774268 --- ParallelTerminationStrategy: PID 12729 died... 02:16:27.794340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12729): Terminated: ok {rc=0} 02:16:27.841761 --- ParallelTerminationStrategy: PID 12732 died... 02:16:27.861831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12732): Terminated: ok {rc=0} 02:16:27.950707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:16:29.100246 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.111871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:29.169403 tst iperf3m4.py: using LAC 25289 02:16:29.294214 tst iperf3m4.py: using RAC 44 02:16:29.418949 tst iperf3m4.py: using CellId 25289 02:16:29.543683 tst iperf3m4.py: using BVCI 25290 02:16:29.658669 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.669934 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.680845 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.692042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.703180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.714340 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.725628 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.736645 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:29.747911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:29.866197 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:29.990865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:30.116238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:30.240257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:30.467171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:30.805578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12734): Launched 02:16:31.154593 run iperf3-srv_10.42.42.10(pid=12735): Launched 02:16:31.325840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:16:31.578041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:31.924621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12736): Launched 02:16:32.231677 run iperf3-srv_10.42.42.10(pid=12737): Launched 02:16:32.358422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:16:32.583725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:32.921355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12738): Launched 02:16:33.215352 run iperf3-srv_10.42.42.10(pid=12739): Launched 02:16:33.341587 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:16:33.566813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:33.904844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12740): Launched 02:16:34.197994 run iperf3-srv_10.42.42.10(pid=12741): Launched 02:16:34.326125 tst iperf3m4.py:8: start network... 02:16:34.551378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:35.072538 run create_hlr_db(pid=12742): Launched 02:16:35.208886 bus /gobi_6: Setting Powered False 02:16:36.274921 run create_hlr_db(pid=12742): Terminated: ok {rc=0} 02:16:36.723608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Launched 02:16:37.041611 run osmo-hlr_10.42.42.2(pid=12745): Launched 02:16:37.161796 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:37.726580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Launched 02:16:38.043288 run osmo-stp_10.42.42.5(pid=12748): Launched 02:16:38.163256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:38.707236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12750): Launched 02:16:38.828329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:39.095742 run patchelf(pid=12751): Launched 02:16:39.271519 run osmo-stp_10.42.42.5(pid=12748): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] 02:16:39.405068 run osmo-stp_10.42.42.5(pid=12748): stdout: | (launched: 2022-12-10_02:16:37.983625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:39.540754 run osmo-stp_10.42.42.5(pid=12748): stderr: | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021638158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:39.676343 run osmo-stp_10.42.42.5(pid=12748): stdout: | (launched: 2022-12-10_02:16:37.983625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:39.805482 run osmo-stp_10.42.42.5(pid=12748): stderr: | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021638157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021638158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021638158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:39.959521 run patchelf(pid=12751): Terminating (SIGINT) 02:16:40.136617 run patchelf(pid=12751): Terminated: ok {rc=0} 02:16:40.264530 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12748): Process ended prematurely: osmo-stp_10.42.42.5(pid=12748) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:16:40.274249 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:16:40.302670 run osmo-hlr_10.42.42.2(pid=12745): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12745)] 02:16:40.351288 run osmo-hlr_10.42.42.2(pid=12745): stdout: | (launched: 2022-12-10_02:16:36.982159) 02:16:40.401524 run osmo-hlr_10.42.42.2(pid=12745): stderr: | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021637160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021637172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021637181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021637181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021637181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:40.452351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12734): Terminating (SIGTERM) 02:16:40.492562 run iperf3-srv_10.42.42.10(pid=12735): Terminating (SIGTERM) 02:16:40.533298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12736): Terminating (SIGTERM) 02:16:40.574246 run iperf3-srv_10.42.42.10(pid=12737): Terminating (SIGTERM) 02:16:40.615000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12738): Terminating (SIGTERM) 02:16:40.655759 run iperf3-srv_10.42.42.10(pid=12739): Terminating (SIGTERM) 02:16:40.696232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12740): Terminating (SIGTERM) 02:16:40.736779 run iperf3-srv_10.42.42.10(pid=12741): Terminating (SIGTERM) 02:16:40.777175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Terminating (SIGTERM) 02:16:40.817834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Terminating (SIGTERM) 02:16:40.858357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12750): Terminating (SIGTERM) 02:16:40.899256 --- ParallelTerminationStrategy: PID 12734 died... 02:16:40.918344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12734): Terminated: ok {rc=0} 02:16:40.963581 --- ParallelTerminationStrategy: PID 12735 died... 02:16:40.982501 run iperf3-srv_10.42.42.10(pid=12735): Terminated {rc=256} 02:16:41.027505 --- ParallelTerminationStrategy: PID 12736 died... 02:16:41.046522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12736): Terminated: ok {rc=0} 02:16:41.091701 --- ParallelTerminationStrategy: PID 12737 died... 02:16:41.110744 run iperf3-srv_10.42.42.10(pid=12737): Terminated {rc=256} 02:16:41.155647 --- ParallelTerminationStrategy: PID 12738 died... 02:16:41.174786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12738): Terminated: ok {rc=0} 02:16:41.219966 --- ParallelTerminationStrategy: PID 12739 died... 02:16:41.239088 run iperf3-srv_10.42.42.10(pid=12739): Terminated {rc=256} 02:16:41.284225 --- ParallelTerminationStrategy: PID 12740 died... 02:16:41.303374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12740): Terminated: ok {rc=0} 02:16:41.348575 --- ParallelTerminationStrategy: PID 12741 died... 02:16:41.367719 run iperf3-srv_10.42.42.10(pid=12741): Terminated {rc=256} 02:16:41.413068 --- ParallelTerminationStrategy: PID 12744 died... 02:16:41.432256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12744): Terminated: ok {rc=0} 02:16:41.477478 --- ParallelTerminationStrategy: PID 12747 died... 02:16:41.496643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12747): Terminated: ok {rc=0} 02:16:41.542429 --- ParallelTerminationStrategy: PID 12750 died... 02:16:41.561613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12750): Terminated: ok {rc=0} 02:16:41.648851 bus /gobi_4: Setting Powered False 02:16:42.750416 bus /gobi_4: Setting Powered False 02:16:43.866072 bus /gobi_1: Setting Powered False 02:16:44.966130 bus /gobi_1: Setting Powered False 02:16:46.098928 bus /gobi_0: Setting Powered False 02:16:47.216374 bus /gobi_0: Setting Powered False 02:16:48.336030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:16:49.440908 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:49.452811 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:49.510772 tst ping.py: using LAC 25290 02:16:49.632140 tst ping.py: using RAC 45 02:16:49.754385 tst ping.py: using CellId 25290 02:16:49.876680 tst ping.py: using BVCI 25291 02:16:49.989741 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.000817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.011723 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.022890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.033884 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.044727 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.055947 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:50.066986 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:50.187419 tst ping.py:19: start network... 02:16:50.411165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:50.923726 run create_hlr_db(pid=12752): Launched 02:16:51.056911 bus /gobi_6: Setting Powered False 02:16:52.122138 run create_hlr_db(pid=12752): Terminated: ok {rc=0} 02:16:52.565042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12754): Launched 02:16:52.875872 run osmo-hlr_10.42.42.2(pid=12755): Launched 02:16:52.992827 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:53.528698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12757): Launched 02:16:53.839864 run osmo-stp_10.42.42.5(pid=12758): Launched 02:16:53.957353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:54.491084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12760): Launched 02:16:54.610009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:54.872235 run patchelf(pid=12761): Launched 02:16:55.044774 run osmo-stp_10.42.42.5(pid=12758): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12758)] 02:16:55.175729 run osmo-stp_10.42.42.5(pid=12758): stdout: | (launched: 2022-12-10_02:16:53.781189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:55.308070 run osmo-stp_10.42.42.5(pid=12758): stderr: | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021653955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:55.441139 run osmo-stp_10.42.42.5(pid=12758): stdout: | (launched: 2022-12-10_02:16:53.781189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:55.567964 run osmo-stp_10.42.42.5(pid=12758): stderr: | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021653955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:55.718439 run patchelf(pid=12761): Terminating (SIGINT) 02:16:55.891748 run patchelf(pid=12761): Terminated: ok {rc=0} 02:16:56.016812 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12758): Process ended prematurely: osmo-stp_10.42.42.5(pid=12758) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12758)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 02:16:56.025996 tst ping.py:22: Test FAILED (6.6 sec) 02:16:56.053786 run osmo-hlr_10.42.42.2(pid=12755): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12755)] 02:16:56.103374 run osmo-hlr_10.42.42.2(pid=12755): stdout: | (launched: 2022-12-10_02:16:52.817646) 02:16:56.154626 run osmo-hlr_10.42.42.2(pid=12755): stderr: | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021652999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021653038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021653049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021653049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021653049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:56.206039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12754): Terminating (SIGTERM) 02:16:56.247049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12757): Terminating (SIGTERM) 02:16:56.288116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12760): Terminating (SIGTERM) 02:16:56.329350 --- ParallelTerminationStrategy: PID 12754 died... 02:16:56.348731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12754): Terminated: ok {rc=0} 02:16:56.394399 --- ParallelTerminationStrategy: PID 12757 died... 02:16:56.413783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12757): Terminated: ok {rc=0} 02:16:56.459139 --- ParallelTerminationStrategy: PID 12760 died... 02:16:56.478212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12760): Terminated: ok {rc=0} 02:16:56.564884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:16:57.654280 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:57.666826 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:57.727801 tst ping_idle_ping.py: using LAC 25291 02:16:57.857510 tst ping_idle_ping.py: using RAC 46 02:16:57.992346 tst ping_idle_ping.py: using CellId 25291 02:16:58.124059 tst ping_idle_ping.py: using BVCI 25292 02:16:58.245965 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.257618 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.268779 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.280360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.291784 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.303213 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.315322 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:58.326784 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:58.444718 tst ping_idle_ping.py:24: start network... 02:16:58.652838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:59.136160 run create_hlr_db(pid=12762): Launched 02:16:59.254146 bus /gobi_6: Setting Powered False 02:17:00.315603 run create_hlr_db(pid=12762): Terminated: ok {rc=0} 02:17:00.750748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Launched 02:17:01.084318 run osmo-hlr_10.42.42.2(pid=12765): Launched 02:17:01.339741 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:02.035749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Launched 02:17:02.369823 run osmo-stp_10.42.42.5(pid=12771): Launched 02:17:02.526723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:03.103023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Launched 02:17:03.230327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:03.512479 run patchelf(pid=12774): Launched 02:17:03.697929 run osmo-stp_10.42.42.5(pid=12771): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] 02:17:03.838033 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-10_02:17:02.306378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:03.979971 run osmo-stp_10.42.42.5(pid=12771): stderr: | [0;m[38;5;43m20221210021702511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021702512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021702512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021702512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:04.122285 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-10_02:17:02.306378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:04.258134 run osmo-stp_10.42.42.5(pid=12771): stderr: | [0;m[38;5;43m20221210021702511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021702512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021702512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021702512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021702513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:04.419363 run patchelf(pid=12774): Terminating (SIGINT) 02:17:04.604876 run patchelf(pid=12774): Terminated: ok {rc=0} 02:17:04.738694 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:17:04.748169 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 02:17:04.776529 run osmo-hlr_10.42.42.2(pid=12765): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12765)] 02:17:04.827473 run osmo-hlr_10.42.42.2(pid=12765): stdout: | (launched: 2022-12-10_02:17:01.022849) 02:17:04.880351 run osmo-hlr_10.42.42.2(pid=12765): stderr: | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021701253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021701271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021701292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021701292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021701292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:04.933743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Terminating (SIGTERM) 02:17:04.976473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Terminating (SIGTERM) 02:17:05.019256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminating (SIGTERM) 02:17:05.062232 --- ParallelTerminationStrategy: PID 12764 died... 02:17:05.082738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Terminated: ok {rc=0} 02:17:05.129942 --- ParallelTerminationStrategy: PID 12770 died... 02:17:05.150037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Terminated: ok {rc=0} 02:17:05.196822 --- ParallelTerminationStrategy: PID 12773 died... 02:17:05.217305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminated: ok {rc=0} 02:17:05.306039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:17:06.603231 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:06.610891 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:17:06.632883 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:17:06.668587 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:17:06.723051 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:17:06.744639 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:17:06.780352 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:17:07.340167 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:17:07.345670 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.357269 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:17:07.415077 tst switch_tch_pdch.py: using LAC 25292 02:17:07.546625 tst switch_tch_pdch.py: using RAC 47 02:17:07.676428 tst switch_tch_pdch.py: using CellId 25292 02:17:07.804706 tst switch_tch_pdch.py: using BVCI 25293 02:17:07.925550 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.937442 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.949081 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.960561 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.972087 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.983654 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:07.995314 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:08.006892 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:08.126147 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:08.245160 tst switch_tch_pdch.py:51: start network... 02:17:08.451219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:08.928345 run create_hlr_db(pid=12779): Launched 02:17:09.046669 bus /gobi_6: Setting Powered False 02:17:10.108751 run create_hlr_db(pid=12779): Terminated: ok {rc=0} 02:17:10.540693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12781): Launched 02:17:10.850458 run osmo-hlr_10.42.42.2(pid=12782): Launched 02:17:10.970860 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:11.517619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12784): Launched 02:17:11.828350 run osmo-stp_10.42.42.5(pid=12785): Launched 02:17:11.946471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:12.481802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12787): Launched 02:17:12.600808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:12.863858 run patchelf(pid=12788): Launched 02:17:13.036019 run osmo-stp_10.42.42.5(pid=12785): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12785)] 02:17:13.166663 run osmo-stp_10.42.42.5(pid=12785): stdout: | (launched: 2022-12-10_02:17:11.769728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:13.299177 run osmo-stp_10.42.42.5(pid=12785): stderr: | [0;m[38;5;43m20221210021711941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021711941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021711942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021711942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:13.431625 run osmo-stp_10.42.42.5(pid=12785): stdout: | (launched: 2022-12-10_02:17:11.769728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:13.557681 run osmo-stp_10.42.42.5(pid=12785): stderr: | [0;m[38;5;43m20221210021711941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021711941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021711942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021711942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021711943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:13.707058 run patchelf(pid=12788): Terminating (SIGINT) 02:17:13.880627 run patchelf(pid=12788): Terminated: ok {rc=0} 02:17:14.005482 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12785): Process ended prematurely: osmo-stp_10.42.42.5(pid=12785) [trial-2368↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12785)] [trial-2368↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:17:14.014301 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:17:14.041920 run osmo-hlr_10.42.42.2(pid=12782): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12782)] 02:17:14.091020 run osmo-hlr_10.42.42.2(pid=12782): stdout: | (launched: 2022-12-10_02:17:10.792105) 02:17:14.143194 run osmo-hlr_10.42.42.2(pid=12782): stderr: | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021710973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021710983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021710991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021710991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021710991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:14.194868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12781): Terminating (SIGTERM) 02:17:14.236234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12784): Terminating (SIGTERM) 02:17:14.277698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12787): Terminating (SIGTERM) 02:17:14.318823 --- ParallelTerminationStrategy: PID 12781 died... 02:17:14.338429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12781): Terminated: ok {rc=0} 02:17:14.384253 --- ParallelTerminationStrategy: PID 12784 died... 02:17:14.403523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12784): Terminated: ok {rc=0} 02:17:14.448773 --- ParallelTerminationStrategy: PID 12787 died... 02:17:14.467836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12787): Terminated: ok {rc=0} 02:17:14.553768 bus /gobi_0: Setting Powered False 02:17:15.653964 bus /gobi_0: Setting Powered False 02:17:16.783369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:17:18.028778 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:18.034642 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:17:18.055680 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:17:18.091483 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:17:18.144608 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:17:18.165558 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:17:18.200184 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:17:18.755169 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:17:18.760193 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:18.771179 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:17:18.827479 tst switch_tch_pdch.py: using LAC 25293 02:17:18.949571 tst switch_tch_pdch.py: using RAC 48 02:17:19.071957 tst switch_tch_pdch.py: using CellId 25293 02:17:19.198071 tst switch_tch_pdch.py: using BVCI 25294 02:17:19.311150 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.322219 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.333168 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.344207 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.355265 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.366214 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.377427 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:19.388462 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:17:19.509473 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:17:19.627705 tst switch_tch_pdch.py:51: start network... 02:17:19.834444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:20.287835 run create_hlr_db(pid=12792): Launched 02:17:20.405073 bus /gobi_6: Setting Powered False 02:17:21.465165 run create_hlr_db(pid=12792): Terminated: ok {rc=0} 02:17:21.889932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12794): Launched 02:17:22.222057 run osmo-hlr_10.42.42.2(pid=12795): Launched 02:17:22.348640 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:22.893561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12797): Launched 02:17:23.225316 run osmo-stp_10.42.42.5(pid=12798): Launched 02:17:23.351494 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:23.894053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12800): Launched 02:17:24.019941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:24.299930 run patchelf(pid=12801): Launched 02:17:24.483714 run osmo-stp_10.42.42.5(pid=12798): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12798)] 02:17:24.623037 run osmo-stp_10.42.42.5(pid=12798): stdout: | (launched: 2022-12-10_02:17:23.163059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:24.763985 run osmo-stp_10.42.42.5(pid=12798): stderr: | [0;m[38;5;43m20221210021723359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021723359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021723360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021723360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021723360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021723361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021723361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:24.904489 run osmo-stp_10.42.42.5(pid=12798): stdout: | (launched: 2022-12-10_02:17:23.163059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:25.039432 run osmo-stp_10.42.42.5(pid=12798): stderr: | [0;m[38;5;43m20221210021723359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021723359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021723360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021723360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021723360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021723361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021723361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:25.199444 run patchelf(pid=12801): Terminating (SIGINT) 02:17:25.384488 run patchelf(pid=12801): Terminated: ok {rc=0} 02:17:25.517377 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12798): Process ended prematurely: osmo-stp_10.42.42.5(pid=12798) [trial-2368↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12798)] [trial-2368↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:17:25.526924 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:17:25.555031 run osmo-hlr_10.42.42.2(pid=12795): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12795)] 02:17:25.605518 run osmo-hlr_10.42.42.2(pid=12795): stdout: | (launched: 2022-12-10_02:17:22.159106) 02:17:25.657796 run osmo-hlr_10.42.42.2(pid=12795): stderr: | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021722362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021722375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021722384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021722385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021722385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:25.710090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12794): Terminating (SIGTERM) 02:17:25.752146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12797): Terminating (SIGTERM) 02:17:25.794519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12800): Terminating (SIGTERM) 02:17:25.836826 --- ParallelTerminationStrategy: PID 12794 died... 02:17:25.857155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12794): Terminated: ok {rc=0} 02:17:25.903458 --- ParallelTerminationStrategy: PID 12797 died... 02:17:25.923322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12797): Terminated: ok {rc=0} 02:17:25.969912 --- ParallelTerminationStrategy: PID 12800 died... 02:17:25.989728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12800): Terminated: ok {rc=0} 02:17:26.079344 bus /gobi_0: Setting Powered False 02:17:27.180411 bus /gobi_0: Setting Powered False 02:17:28.300001 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:oc2g --------------------------------------------------------------------- 02:17:29.544686 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:29.548656 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 02:17:29.569965 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 02:17:29.578767 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 02:17:29.632254 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 02:17:29.653598 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 02:17:29.660558 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 02:17:30.199856 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:17:30.204888 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 02:17:30.216123 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 02:17:30.251262 tst mo_mt_sms.py: using LAC 25294 02:17:30.376682 tst mo_mt_sms.py: using RAC 49 02:17:30.508439 tst mo_mt_sms.py: using CellId 25294 02:17:30.639085 tst mo_mt_sms.py: using BVCI 25295 02:17:30.759377 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:17:30.894145 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:17:31.031431 tst mo_mt_sms.py:9: start nitb and bts... 02:17:31.335345 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:17:31.997669 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12809): Launched 02:17:32.330417 run osmo-nitb_10.42.42.2(pid=12810): Launched 02:17:32.502061 run osmo-nitb_10.42.42.2(pid=12810): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12810)] 02:17:32.641253 run osmo-nitb_10.42.42.2(pid=12810): stdout: | (launched: 2022-12-10_02:17:32.271026) 02:17:32.781500 run osmo-nitb_10.42.42.2(pid=12810): stderr: | (launched: 2022-12-10_02:17:32.317513) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:32.921464 run osmo-nitb_10.42.42.2(pid=12810): stdout: | (launched: 2022-12-10_02:17:32.271026) 02:17:33.055982 run osmo-nitb_10.42.42.2(pid=12810): stderr: | (launched: 2022-12-10_02:17:32.317513) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12810): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12810) [trial-2368↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12810)] 02:17:33.447377 tst osmo-nitb_10.42.42.2(pid=12810): stdout: | (launched: 2022-12-10_02:17:32.271026) 02:17:33.571591 tst osmo-nitb_10.42.42.2(pid=12810): stderr: | (launched: 2022-12-10_02:17:32.317513) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:33.718181 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12810): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12810) [trial-2368↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12810)] [trial-2368↪nitb_sms:oc2g↪mo_mt_sms.py:11] 02:17:33.726651 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 02:17:33.733203 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12809): Terminating (SIGTERM) 02:17:33.943267 --- ParallelTerminationStrategy: PID 12809 died... 02:17:33.964272 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12809): Terminated: ok {rc=0} 02:17:34.049870 bus /sierra_3: Setting Powered False 02:17:35.150886 bus /sierra_3: Setting Powered False 02:17:36.268933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:oc2g --------------------------------------------------------------------- 02:17:37.456402 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:37.460649 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 02:17:37.481878 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 02:17:37.511749 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 02:17:37.565493 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 02:17:37.586821 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 02:17:37.614827 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 02:17:38.161632 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:17:38.166689 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.177756 tst sms:oc2g: Using 1 x bts (candidates: 1) 02:17:38.213464 tst mo_mt_sms.py: using LAC 25295 02:17:38.343721 tst mo_mt_sms.py: using RAC 50 02:17:38.469462 tst mo_mt_sms.py: using CellId 25295 02:17:38.593812 tst mo_mt_sms.py: using BVCI 25296 02:17:38.707853 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.718705 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.729495 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.739994 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.750725 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:17:38.761447 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:17:38.881826 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:17:39.003527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:39.518250 run create_hlr_db(pid=12814): Launched 02:17:39.653396 bus /sierra_2: Setting Powered False 02:17:40.718667 run create_hlr_db(pid=12814): Terminated: ok {rc=0} 02:17:41.180542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Launched 02:17:41.513123 run osmo-hlr_10.42.42.2(pid=12817): Launched 02:17:41.638649 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:42.209543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Launched 02:17:42.544432 run osmo-stp_10.42.42.5(pid=12820): Launched 02:17:42.672693 run osmo-msc_10.42.42.6: Starting osmo-msc 02:17:43.273048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12822): Launched 02:17:43.606237 run osmo-msc_10.42.42.6(pid=12823): Launched 02:17:43.790254 run osmo-stp_10.42.42.5(pid=12820): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] 02:17:43.929785 run osmo-stp_10.42.42.5(pid=12820): stdout: | (launched: 2022-12-10_02:17:42.481989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:44.069967 run osmo-stp_10.42.42.5(pid=12820): stderr: | [0;m[38;5;43m20221210021742679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021742680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021742680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021742680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:44.208380 run osmo-stp_10.42.42.5(pid=12820): stdout: | (launched: 2022-12-10_02:17:42.481989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:44.339952 run osmo-stp_10.42.42.5(pid=12820): stderr: | [0;m[38;5;43m20221210021742679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021742680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021742680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021742680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021742681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:44.497645 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12820): Process ended prematurely: osmo-stp_10.42.42.5(pid=12820) [trial-2368↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] [trial-2368↪sms:oc2g↪mo_mt_sms.py:16] 02:17:44.506841 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 02:17:44.534683 run osmo-hlr_10.42.42.2(pid=12817): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12817)] 02:17:44.585753 run osmo-hlr_10.42.42.2(pid=12817): stdout: | (launched: 2022-12-10_02:17:41.451195) 02:17:44.638351 run osmo-hlr_10.42.42.2(pid=12817): stderr: | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021741652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021741665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021741673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021741673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021741673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:44.711809 run osmo-msc_10.42.42.6(pid=12823): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12823)] 02:17:44.762992 run osmo-msc_10.42.42.6(pid=12823): stdout: | (launched: 2022-12-10_02:17:43.543743) 02:17:44.815715 run osmo-msc_10.42.42.6(pid=12823): stderr: | [0;m[38;5;43m20221210021743869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021743869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac18881c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021743869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021743869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021743869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021743869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021743873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021743873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021743873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021743874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:17:44.868837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Terminating (SIGTERM) 02:17:44.911500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Terminating (SIGTERM) 02:17:44.954432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12822): Terminating (SIGTERM) 02:17:44.997800 --- ParallelTerminationStrategy: PID 12816 died... 02:17:45.018337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Terminated: ok {rc=0} 02:17:45.065544 --- ParallelTerminationStrategy: PID 12819 died... 02:17:45.085636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Terminated: ok {rc=0} 02:17:45.132731 --- ParallelTerminationStrategy: PID 12822 died... 02:17:45.152894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12822): Terminated: ok {rc=0} 02:17:45.242677 bus /sierra_3: Setting Powered False 02:17:46.343877 bus /sierra_3: Setting Powered False 02:17:47.463870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:oc2g --------------------------------------------------------------------- 02:17:48.682448 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:48.687156 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:17:48.708615 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 02:17:48.716113 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:17:48.752498 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:17:48.774041 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 02:17:48.781238 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:17:49.299246 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 02:17:49.304530 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 02:17:49.315310 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 02:17:49.349432 tst assert_extension.py: using LAC 25296 02:17:49.472740 tst assert_extension.py: using RAC 51 02:17:49.593643 tst assert_extension.py: using CellId 25296 02:17:49.717094 tst assert_extension.py: using BVCI 25297 02:17:49.830388 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 02:17:49.949415 tst assert_extension.py:10: start nitb and bts... 02:17:50.172279 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:17:50.845401 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12830): Launched 02:17:51.177631 run osmo-nitb_10.42.42.2(pid=12831): Launched 02:17:51.360467 run osmo-nitb_10.42.42.2(pid=12831): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12831)] 02:17:51.509436 run osmo-nitb_10.42.42.2(pid=12831): stdout: | (launched: 2022-12-10_02:17:51.115435) 02:17:51.658773 run osmo-nitb_10.42.42.2(pid=12831): stderr: | (launched: 2022-12-10_02:17:51.164595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:51.808217 run osmo-nitb_10.42.42.2(pid=12831): stdout: | (launched: 2022-12-10_02:17:51.115435) 02:17:51.952798 run osmo-nitb_10.42.42.2(pid=12831): stderr: | (launched: 2022-12-10_02:17:51.164595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12831) [trial-2368↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12831)] 02:17:52.301425 tst osmo-nitb_10.42.42.2(pid=12831): stdout: | (launched: 2022-12-10_02:17:51.115435) 02:17:52.435244 tst osmo-nitb_10.42.42.2(pid=12831): stderr: | (launched: 2022-12-10_02:17:51.164595) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:52.592522 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12831) [trial-2368↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12831)] [trial-2368↪nitb_ussd:oc2g↪assert_extension.py:12] 02:17:52.601442 tst assert_extension.py:12: Test FAILED (3.3 sec) 02:17:52.608563 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12830): Terminating (SIGTERM) 02:17:52.819310 --- ParallelTerminationStrategy: PID 12830 died... 02:17:52.841226 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12830): Terminated: ok {rc=0} 02:17:52.929615 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:oc2g --------------------------------------------------------------------- 02:17:54.094477 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:54.098362 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:17:54.119007 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 02:17:54.147148 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:17:54.182738 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:17:54.203529 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 02:17:54.231136 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:17:54.757761 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:oc2g assert_extension.py ---------------------------------------------- 02:17:54.763014 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:54.773801 tst ussd:oc2g: Using 1 x bts (candidates: 1) 02:17:54.810188 tst assert_extension.py: using LAC 25297 02:17:54.937158 tst assert_extension.py: using RAC 52 02:17:55.057252 tst assert_extension.py: using CellId 25297 02:17:55.182054 tst assert_extension.py: using BVCI 25298 02:17:55.295430 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:55.306097 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:55.316556 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:55.327277 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:55.338031 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:17:55.348876 tst ussd:oc2g: Using 1 x modem (candidates: 1) 02:17:55.467534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:55.947878 run create_hlr_db(pid=12835): Launched 02:17:56.065638 bus /sierra_2: Setting Powered False 02:17:57.127502 run create_hlr_db(pid=12835): Terminated: ok {rc=0} 02:17:57.583677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12837): Launched 02:17:57.916464 run osmo-hlr_10.42.42.2(pid=12838): Launched 02:17:58.042985 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:58.620464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12840): Launched 02:17:58.933535 run osmo-stp_10.42.42.5(pid=12841): Launched 02:17:59.051920 run osmo-msc_10.42.42.6: Starting osmo-msc 02:17:59.611604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12843): Launched 02:17:59.923033 run osmo-msc_10.42.42.6(pid=12844): Launched 02:18:00.095700 run osmo-stp_10.42.42.5(pid=12841): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12841)] 02:18:00.227249 run osmo-stp_10.42.42.5(pid=12841): stdout: | (launched: 2022-12-10_02:17:58.874989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:00.358520 run osmo-stp_10.42.42.5(pid=12841): stderr: | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021759048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:00.488386 run osmo-stp_10.42.42.5(pid=12841): stdout: | (launched: 2022-12-10_02:17:58.874989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:00.612017 run osmo-stp_10.42.42.5(pid=12841): stderr: | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021759047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021759048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021759048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:00.759776 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12841): Process ended prematurely: osmo-stp_10.42.42.5(pid=12841) [trial-2368↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12841)] [trial-2368↪ussd:oc2g↪assert_extension.py:17] 02:18:00.768294 tst assert_extension.py:17: Test FAILED (6.0 sec) 02:18:00.795482 run osmo-hlr_10.42.42.2(pid=12838): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12838)] 02:18:00.857832 run osmo-hlr_10.42.42.2(pid=12838): stdout: | (launched: 2022-12-10_02:17:57.854132) 02:18:00.926712 run osmo-hlr_10.42.42.2(pid=12838): stderr: | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021758057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021758071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021758079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021758080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021758080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:01.002252 run osmo-msc_10.42.42.6(pid=12844): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12844)] 02:18:01.063312 run osmo-msc_10.42.42.6(pid=12844): stdout: | (launched: 2022-12-10_02:17:59.864139) 02:18:01.118829 run osmo-msc_10.42.42.6(pid=12844): stderr: | [0;m[38;5;43m20221210021800136 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021800137 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1306c05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021800137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021800137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021800137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021800137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021800139 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021800139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021800139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021800139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:01.174149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12837): Terminating (SIGTERM) 02:18:01.219826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12840): Terminating (SIGTERM) 02:18:01.264922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12843): Terminating (SIGTERM) 02:18:01.312353 --- ParallelTerminationStrategy: PID 12837 died... 02:18:01.333590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12837): Terminated: ok {rc=0} 02:18:01.385282 --- ParallelTerminationStrategy: PID 12840 died... 02:18:01.406742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12840): Terminated: ok {rc=0} 02:18:01.457755 --- ParallelTerminationStrategy: PID 12843 died... 02:18:01.478427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12843): Terminated: ok {rc=0} 02:18:01.572574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:18:02.776573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:02.784022 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:18:02.805721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:18:02.834598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:18:02.888270 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:18:02.909782 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:18:02.937567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:18:03.489771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:18:03.543727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:03.555234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:03.613599 tst mo_mt_call.py: using LAC 25298 02:18:03.746358 tst mo_mt_call.py: using RAC 53 02:18:03.878271 tst mo_mt_call.py: using CellId 25298 02:18:04.009140 tst mo_mt_call.py: using BVCI 25299 02:18:04.130700 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:04.142481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:04.153872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:04.165254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:04.176775 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:04.188305 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:04.309390 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:04.428663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:04.919529 run create_hlr_db(pid=12849): Launched 02:18:05.041303 bus /sierra_2: Setting Powered False 02:18:06.103372 run create_hlr_db(pid=12849): Terminated: ok {rc=0} 02:18:06.542543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12851): Launched 02:18:06.859683 run osmo-hlr_10.42.42.2(pid=12852): Launched 02:18:06.981168 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:07.538938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12854): Launched 02:18:07.857307 run osmo-stp_10.42.42.5(pid=12855): Launched 02:18:07.979140 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:08.552430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12857): Launched 02:18:08.870960 run osmo-msc_10.42.42.6(pid=12858): Launched 02:18:09.047931 run osmo-stp_10.42.42.5(pid=12855): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12855)] 02:18:09.181474 run osmo-stp_10.42.42.5(pid=12855): stdout: | (launched: 2022-12-10_02:18:07.797324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:09.315113 run osmo-stp_10.42.42.5(pid=12855): stderr: | [0;m[38;5;43m20221210021807970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021807971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021807971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021807971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:09.447385 run osmo-stp_10.42.42.5(pid=12855): stdout: | (launched: 2022-12-10_02:18:07.797324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:09.572393 run osmo-stp_10.42.42.5(pid=12855): stderr: | [0;m[38;5;43m20221210021807970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021807971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021807971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021807971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021807972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:09.722696 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12855): Process ended prematurely: osmo-stp_10.42.42.5(pid=12855) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12855)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:18:09.731542 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:18:09.758845 run osmo-hlr_10.42.42.2(pid=12852): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12852)] 02:18:09.807780 run osmo-hlr_10.42.42.2(pid=12852): stdout: | (launched: 2022-12-10_02:18:06.799903) 02:18:09.858217 run osmo-hlr_10.42.42.2(pid=12852): stderr: | [0;m[1;31m20221210021806977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021806977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021806977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021806977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021806978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021806978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021806994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021807004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021807004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021807004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:09.928393 run osmo-msc_10.42.42.6(pid=12858): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12858)] 02:18:09.977255 run osmo-msc_10.42.42.6(pid=12858): stdout: | (launched: 2022-12-10_02:18:08.811068) 02:18:10.027792 run osmo-msc_10.42.42.6(pid=12858): stderr: | [0;m[38;5;43m20221210021809085 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021809085 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4c73d25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021809086 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021809086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021809086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021809086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021809088 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021809088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021809088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021809088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:10.078875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12851): Terminating (SIGTERM) 02:18:10.119683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12854): Terminating (SIGTERM) 02:18:10.160364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12857): Terminating (SIGTERM) 02:18:10.200766 --- ParallelTerminationStrategy: PID 12851 died... 02:18:10.220188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12851): Terminated: ok {rc=0} 02:18:10.265071 --- ParallelTerminationStrategy: PID 12854 died... 02:18:10.283921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12854): Terminated: ok {rc=0} 02:18:10.328770 --- ParallelTerminationStrategy: PID 12857 died... 02:18:10.347713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12857): Terminated: ok {rc=0} 02:18:10.434260 bus /sierra_3: Setting Powered False 02:18:11.535054 bus /sierra_3: Setting Powered False 02:18:12.652451 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:18:13.804452 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:13.817062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:13.876415 tst mo_mt_call_osmux.py: using LAC 25299 02:18:14.009917 tst mo_mt_call_osmux.py: using RAC 54 02:18:14.134607 tst mo_mt_call_osmux.py: using CellId 25299 02:18:14.259461 tst mo_mt_call_osmux.py: using BVCI 25300 02:18:14.376218 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:14.387606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:14.398849 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:14.410339 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:14.421504 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:14.433565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:14.551414 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:14.668853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:15.158174 run create_hlr_db(pid=12860): Launched 02:18:15.278559 bus /sierra_2: Setting Powered False 02:18:16.338988 run create_hlr_db(pid=12860): Terminated: ok {rc=0} 02:18:16.787872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12862): Launched 02:18:17.123144 run osmo-hlr_10.42.42.2(pid=12863): Launched 02:18:17.247247 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:17.808750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12865): Launched 02:18:18.126836 run osmo-stp_10.42.42.5(pid=12866): Launched 02:18:18.247517 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:18.818332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12868): Launched 02:18:19.135463 run osmo-msc_10.42.42.6(pid=12869): Launched 02:18:19.312223 run osmo-stp_10.42.42.5(pid=12866): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12866)] 02:18:19.445944 run osmo-stp_10.42.42.5(pid=12866): stdout: | (launched: 2022-12-10_02:18:18.066615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:19.578929 run osmo-stp_10.42.42.5(pid=12866): stderr: | [0;m[38;5;43m20221210021818241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021818241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021818242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021818242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021818242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021818243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021818243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:19.710511 run osmo-stp_10.42.42.5(pid=12866): stdout: | (launched: 2022-12-10_02:18:18.066615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:19.835476 run osmo-stp_10.42.42.5(pid=12866): stderr: | [0;m[38;5;43m20221210021818241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021818241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021818242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021818242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021818242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021818243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021818243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:19.984762 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12866): Process ended prematurely: osmo-stp_10.42.42.5(pid=12866) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12866)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:18:19.993977 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:18:20.021235 run osmo-hlr_10.42.42.2(pid=12863): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12863)] 02:18:20.070117 run osmo-hlr_10.42.42.2(pid=12863): stdout: | (launched: 2022-12-10_02:18:17.062420) 02:18:20.120537 run osmo-hlr_10.42.42.2(pid=12863): stderr: | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021817302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021817315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021817323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021817323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021817323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:20.190491 run osmo-msc_10.42.42.6(pid=12869): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12869)] 02:18:20.239140 run osmo-msc_10.42.42.6(pid=12869): stdout: | (launched: 2022-12-10_02:18:19.075584) 02:18:20.289443 run osmo-msc_10.42.42.6(pid=12869): stderr: | [0;m[38;5;43m20221210021819354 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021819354 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f353eda2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021819354 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021819354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021819354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021819354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021819356 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021819356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021819357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021819357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:20.340216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12862): Terminating (SIGTERM) 02:18:20.380591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12865): Terminating (SIGTERM) 02:18:20.420792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12868): Terminating (SIGTERM) 02:18:20.461453 --- ParallelTerminationStrategy: PID 12862 died... 02:18:20.480859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12862): Terminated: ok {rc=0} 02:18:20.526359 --- ParallelTerminationStrategy: PID 12865 died... 02:18:20.545430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12865): Terminated: ok {rc=0} 02:18:20.590855 --- ParallelTerminationStrategy: PID 12868 died... 02:18:20.609796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12868): Terminated: ok {rc=0} 02:18:20.697109 bus /sierra_3: Setting Powered False 02:18:21.798173 bus /sierra_3: Setting Powered False 02:18:22.914545 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:18:24.153708 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:24.160613 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:18:24.182166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:18:24.209581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:18:24.263963 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:18:24.285555 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:18:24.313195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:18:24.862855 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:18:24.916092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:24.927931 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:18:24.985697 tst mo_mt_call.py: using LAC 25300 02:18:25.116498 tst mo_mt_call.py: using RAC 55 02:18:25.247767 tst mo_mt_call.py: using CellId 25300 02:18:25.379179 tst mo_mt_call.py: using BVCI 25301 02:18:25.503030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:25.514764 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:25.526322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:25.537753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:25.549176 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:25.560624 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:25.679498 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:25.796052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:26.287017 run create_hlr_db(pid=12874): Launched 02:18:26.408688 bus /sierra_2: Setting Powered False 02:18:27.472224 run create_hlr_db(pid=12874): Terminated: ok {rc=0} 02:18:27.933772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12876): Launched 02:18:28.271809 run osmo-hlr_10.42.42.2(pid=12877): Launched 02:18:28.401201 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:28.983433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12879): Launched 02:18:29.321398 run osmo-stp_10.42.42.5(pid=12880): Launched 02:18:29.449700 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:30.061811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12882): Launched 02:18:30.400120 run osmo-msc_10.42.42.6(pid=12883): Launched 02:18:30.589777 run osmo-stp_10.42.42.5(pid=12880): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12880)] 02:18:30.731123 run osmo-stp_10.42.42.5(pid=12880): stdout: | (launched: 2022-12-10_02:18:29.258065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:30.922187 run osmo-stp_10.42.42.5(pid=12880): stderr: | [0;m[38;5;43m20221210021829457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021829457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021829458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021829458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021829458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021829459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021829459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:31.065500 run osmo-stp_10.42.42.5(pid=12880): stdout: | (launched: 2022-12-10_02:18:29.258065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:31.200542 run osmo-stp_10.42.42.5(pid=12880): stderr: | [0;m[38;5;43m20221210021829457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021829457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021829458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021829458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021829458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021829459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021829459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:31.362953 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12880): Process ended prematurely: osmo-stp_10.42.42.5(pid=12880) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12880)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:18:31.372781 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:18:31.402357 run osmo-hlr_10.42.42.2(pid=12877): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12877)] 02:18:31.454126 run osmo-hlr_10.42.42.2(pid=12877): stdout: | (launched: 2022-12-10_02:18:28.208405) 02:18:31.507624 run osmo-hlr_10.42.42.2(pid=12877): stderr: | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021828412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021828425 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021828436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021828436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021828436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:31.582379 run osmo-msc_10.42.42.6(pid=12883): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12883)] 02:18:31.634322 run osmo-msc_10.42.42.6(pid=12883): stdout: | (launched: 2022-12-10_02:18:30.336143) 02:18:31.687282 run osmo-msc_10.42.42.6(pid=12883): stderr: | [0;m[38;5;43m20221210021830663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021830663 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9694140c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021830664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021830664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021830664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021830664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021830666 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021830666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021830666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021830666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:31.740874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12876): Terminating (SIGTERM) 02:18:31.784152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12879): Terminating (SIGTERM) 02:18:31.828437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12882): Terminating (SIGTERM) 02:18:31.872449 --- ParallelTerminationStrategy: PID 12876 died... 02:18:31.893485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12876): Terminated: ok {rc=0} 02:18:31.942303 --- ParallelTerminationStrategy: PID 12879 died... 02:18:31.962709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12879): Terminated: ok {rc=0} 02:18:32.010024 --- ParallelTerminationStrategy: PID 12882 died... 02:18:32.030246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12882): Terminated: ok {rc=0} 02:18:32.119310 bus /sierra_3: Setting Powered False 02:18:33.222008 bus /sierra_3: Setting Powered False 02:18:34.339878 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:18:35.489537 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:35.501578 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:18:35.557706 tst mo_mt_call_osmux.py: using LAC 25301 02:18:35.686508 tst mo_mt_call_osmux.py: using RAC 56 02:18:35.810664 tst mo_mt_call_osmux.py: using CellId 25301 02:18:35.934262 tst mo_mt_call_osmux.py: using BVCI 25302 02:18:36.050833 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:36.062159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:36.073145 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:36.084510 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:36.095788 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:36.107087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:36.230026 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:36.356781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:36.882947 run create_hlr_db(pid=12885): Launched 02:18:37.019361 bus /sierra_2: Setting Powered False 02:18:38.085330 run create_hlr_db(pid=12885): Terminated: ok {rc=0} 02:18:38.554736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Launched 02:18:38.893508 run osmo-hlr_10.42.42.2(pid=12888): Launched 02:18:39.021779 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:39.609866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Launched 02:18:39.948499 run osmo-stp_10.42.42.5(pid=12891): Launched 02:18:40.076662 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:40.686845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12893): Launched 02:18:41.025547 run osmo-msc_10.42.42.6(pid=12894): Launched 02:18:41.213489 run osmo-stp_10.42.42.5(pid=12891): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] 02:18:41.355128 run osmo-stp_10.42.42.5(pid=12891): stdout: | (launched: 2022-12-10_02:18:39.885204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:41.496922 run osmo-stp_10.42.42.5(pid=12891): stderr: | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021840082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:41.637589 run osmo-stp_10.42.42.5(pid=12891): stdout: | (launched: 2022-12-10_02:18:39.885204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:41.770682 run osmo-stp_10.42.42.5(pid=12891): stderr: | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021840082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021840082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021840083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:41.930325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12891): Process ended prematurely: osmo-stp_10.42.42.5(pid=12891) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:18:41.939743 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:18:41.967770 run osmo-hlr_10.42.42.2(pid=12888): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12888)] 02:18:42.018048 run osmo-hlr_10.42.42.2(pid=12888): stdout: | (launched: 2022-12-10_02:18:38.830401) 02:18:42.070141 run osmo-hlr_10.42.42.2(pid=12888): stderr: | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021839034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021839045 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021839054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021839054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021839054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:42.142806 run osmo-msc_10.42.42.6(pid=12894): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12894)] 02:18:42.193307 run osmo-msc_10.42.42.6(pid=12894): stdout: | (launched: 2022-12-10_02:18:40.962225) 02:18:42.245265 run osmo-msc_10.42.42.6(pid=12894): stderr: | [0;m[38;5;43m20221210021841287 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021841287 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf9902ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021841287 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021841287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021841287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021841288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021841289 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021841290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021841290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021841290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:42.297496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Terminating (SIGTERM) 02:18:42.339553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Terminating (SIGTERM) 02:18:42.382109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12893): Terminating (SIGTERM) 02:18:42.424515 --- ParallelTerminationStrategy: PID 12887 died... 02:18:42.444843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Terminated: ok {rc=0} 02:18:42.491307 --- ParallelTerminationStrategy: PID 12890 died... 02:18:42.510959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Terminated: ok {rc=0} 02:18:42.557279 --- ParallelTerminationStrategy: PID 12893 died... 02:18:42.576920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12893): Terminated: ok {rc=0} 02:18:42.664867 bus /sierra_3: Setting Powered False 02:18:43.765169 bus /sierra_3: Setting Powered False 02:18:44.882882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:18:46.149923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:46.160198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:18:46.186443 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:18:46.217330 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:18:46.272352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:18:46.307296 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:18:46.342397 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:18:46.887108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:18:46.958454 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:46.972739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:18:47.041288 tst mo_mt_call.py: using LAC 25302 02:18:47.202289 tst mo_mt_call.py: using RAC 57 02:18:47.328902 tst mo_mt_call.py: using CellId 25302 02:18:47.452390 tst mo_mt_call.py: using BVCI 25303 02:18:47.568861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:47.580493 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:47.591560 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:47.602896 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:47.614378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:47.625612 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:18:47.748739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:18:47.868289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:48.360056 run create_hlr_db(pid=12899): Launched 02:18:48.479820 bus /sierra_2: Setting Powered False 02:18:49.541515 run create_hlr_db(pid=12899): Terminated: ok {rc=0} 02:18:50.001658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12901): Launched 02:18:50.340112 run osmo-hlr_10.42.42.2(pid=12902): Launched 02:18:50.469399 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:51.051056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12904): Launched 02:18:51.389821 run osmo-stp_10.42.42.5(pid=12905): Launched 02:18:51.521076 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:52.133211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12907): Launched 02:18:52.473578 run osmo-msc_10.42.42.6(pid=12908): Launched 02:18:52.662560 run osmo-stp_10.42.42.5(pid=12905): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12905)] 02:18:52.804773 run osmo-stp_10.42.42.5(pid=12905): stdout: | (launched: 2022-12-10_02:18:51.325711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:52.948058 run osmo-stp_10.42.42.5(pid=12905): stderr: | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021851526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:53.089300 run osmo-stp_10.42.42.5(pid=12905): stdout: | (launched: 2022-12-10_02:18:51.325711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:53.223576 run osmo-stp_10.42.42.5(pid=12905): stderr: | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021851525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021851526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021851526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:53.385351 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12905): Process ended prematurely: osmo-stp_10.42.42.5(pid=12905) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12905)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:18:53.394880 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:18:53.423235 run osmo-hlr_10.42.42.2(pid=12902): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12902)] 02:18:53.474298 run osmo-hlr_10.42.42.2(pid=12902): stdout: | (launched: 2022-12-10_02:18:50.277048) 02:18:53.527092 run osmo-hlr_10.42.42.2(pid=12902): stderr: | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021850480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021850492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021850501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021850501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021850501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:53.600922 run osmo-msc_10.42.42.6(pid=12908): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12908)] 02:18:53.652016 run osmo-msc_10.42.42.6(pid=12908): stdout: | (launched: 2022-12-10_02:18:52.409458) 02:18:53.704657 run osmo-msc_10.42.42.6(pid=12908): stderr: | [0;m[38;5;43m20221210021852738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021852738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65dc6f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021852738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021852738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021852738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021852739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021852740 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021852741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021852741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021852741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:53.757702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12901): Terminating (SIGTERM) 02:18:53.800099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12904): Terminating (SIGTERM) 02:18:53.842594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12907): Terminating (SIGTERM) 02:18:53.885379 --- ParallelTerminationStrategy: PID 12901 died... 02:18:53.905667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12901): Terminated: ok {rc=0} 02:18:53.952443 --- ParallelTerminationStrategy: PID 12904 died... 02:18:53.972193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12904): Terminated: ok {rc=0} 02:18:54.019187 --- ParallelTerminationStrategy: PID 12907 died... 02:18:54.039074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12907): Terminated: ok {rc=0} 02:18:54.128131 bus /sierra_3: Setting Powered False 02:18:55.230268 bus /sierra_3: Setting Powered False 02:18:56.349148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:18:57.503549 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:57.516105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:18:57.574481 tst mo_mt_call_osmux.py: using LAC 25303 02:18:57.705813 tst mo_mt_call_osmux.py: using RAC 58 02:18:57.831152 tst mo_mt_call_osmux.py: using CellId 25303 02:18:57.956036 tst mo_mt_call_osmux.py: using BVCI 25304 02:18:58.072345 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:58.083641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:58.094800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:58.106100 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:58.117414 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:18:58.128524 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:18:58.250196 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:18:58.375411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:58.901557 run create_hlr_db(pid=12910): Launched 02:18:59.039332 bus /sierra_2: Setting Powered False 02:19:00.105203 run create_hlr_db(pid=12910): Terminated: ok {rc=0} 02:19:00.557274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12912): Launched 02:19:00.879422 run osmo-hlr_10.42.42.2(pid=12913): Launched 02:19:01.125120 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:02.069357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Launched 02:19:02.402505 run osmo-stp_10.42.42.5(pid=12920): Launched 02:19:02.562227 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:03.178149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Launched 02:19:03.518649 run osmo-msc_10.42.42.6(pid=12923): Launched 02:19:03.707650 run osmo-stp_10.42.42.5(pid=12920): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] 02:19:03.849188 run osmo-stp_10.42.42.5(pid=12920): stdout: | (launched: 2022-12-10_02:19:02.339170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:03.991479 run osmo-stp_10.42.42.5(pid=12920): stderr: | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021902573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.132541 run osmo-stp_10.42.42.5(pid=12920): stdout: | (launched: 2022-12-10_02:19:02.339170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:04.266085 run osmo-stp_10.42.42.5(pid=12920): stderr: | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021902572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021902573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021902573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.426469 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12920): Process ended prematurely: osmo-stp_10.42.42.5(pid=12920) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:19:04.435843 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 02:19:04.464121 run osmo-hlr_10.42.42.2(pid=12913): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12913)] 02:19:04.514838 run osmo-hlr_10.42.42.2(pid=12913): stdout: | (launched: 2022-12-10_02:19:00.815142) 02:19:04.567398 run osmo-hlr_10.42.42.2(pid=12913): stderr: | [0;m[1;31m20221210021901125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021901125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021901125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021901125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021901126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021901126 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021901151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021901163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021901163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021901163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:04.640880 run osmo-msc_10.42.42.6(pid=12923): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12923)] 02:19:04.691774 run osmo-msc_10.42.42.6(pid=12923): stdout: | (launched: 2022-12-10_02:19:03.454634) 02:19:04.743994 run osmo-msc_10.42.42.6(pid=12923): stderr: | [0;m[38;5;43m20221210021903787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021903787 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f471a49cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021903787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021903787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021903788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021903788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021903789 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021903790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021903790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021903790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:04.797134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12912): Terminating (SIGTERM) 02:19:04.839487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Terminating (SIGTERM) 02:19:04.881874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Terminating (SIGTERM) 02:19:04.924505 --- ParallelTerminationStrategy: PID 12912 died... 02:19:04.944937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12912): Terminated: ok {rc=0} 02:19:04.991914 --- ParallelTerminationStrategy: PID 12919 died... 02:19:05.012014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Terminated: ok {rc=0} 02:19:05.058968 --- ParallelTerminationStrategy: PID 12922 died... 02:19:05.079008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Terminated: ok {rc=0} 02:19:05.167969 bus /sierra_3: Setting Powered False 02:19:06.269485 bus /sierra_3: Setting Powered False 02:19:07.387378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:19:08.627884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:08.635272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:19:08.656884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:19:08.684869 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:19:08.737907 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:19:08.758713 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:19:08.786438 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:19:09.335458 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:19:09.386342 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:09.397730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:19:09.452938 tst mo_mt_call.py: using LAC 25304 02:19:09.584047 tst mo_mt_call.py: using RAC 59 02:19:09.716481 tst mo_mt_call.py: using CellId 25304 02:19:09.848658 tst mo_mt_call.py: using BVCI 25305 02:19:09.970676 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:09.982409 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:09.993872 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:10.005281 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:10.016575 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:10.028058 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:10.145383 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:10.269669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:10.800694 run create_hlr_db(pid=12928): Launched 02:19:10.935306 bus /sierra_2: Setting Powered False 02:19:12.000535 run create_hlr_db(pid=12928): Terminated: ok {rc=0} 02:19:12.461675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Launched 02:19:12.794415 run osmo-hlr_10.42.42.2(pid=12931): Launched 02:19:12.920412 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:13.492000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Launched 02:19:13.824050 run osmo-stp_10.42.42.5(pid=12934): Launched 02:19:13.950559 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:14.550659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Launched 02:19:14.882401 run osmo-msc_10.42.42.6(pid=12937): Launched 02:19:15.068011 run osmo-stp_10.42.42.5(pid=12934): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] 02:19:15.207838 run osmo-stp_10.42.42.5(pid=12934): stdout: | (launched: 2022-12-10_02:19:13.761903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:15.347820 run osmo-stp_10.42.42.5(pid=12934): stderr: | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021913960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:15.487214 run osmo-stp_10.42.42.5(pid=12934): stdout: | (launched: 2022-12-10_02:19:13.761903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:15.618511 run osmo-stp_10.42.42.5(pid=12934): stderr: | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021913959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021913960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021913960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:15.775942 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12934): Process ended prematurely: osmo-stp_10.42.42.5(pid=12934) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:19:15.785611 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:19:15.813853 run osmo-hlr_10.42.42.2(pid=12931): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12931)] 02:19:15.873072 run osmo-hlr_10.42.42.2(pid=12931): stdout: | (launched: 2022-12-10_02:19:12.732590) 02:19:15.937355 run osmo-hlr_10.42.42.2(pid=12931): stderr: | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021912936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021912948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021912957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021912957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021912957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:16.010203 run osmo-msc_10.42.42.6(pid=12937): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12937)] 02:19:16.062157 run osmo-msc_10.42.42.6(pid=12937): stdout: | (launched: 2022-12-10_02:19:14.820360) 02:19:16.114737 run osmo-msc_10.42.42.6(pid=12937): stderr: | [0;m[38;5;43m20221210021915148 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021915148 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98bb3a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021915148 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021915148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021915149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021915149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021915150 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021915151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021915151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021915151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:16.168465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Terminating (SIGTERM) 02:19:16.212182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Terminating (SIGTERM) 02:19:16.257841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Terminating (SIGTERM) 02:19:16.303191 --- ParallelTerminationStrategy: PID 12930 died... 02:19:16.323458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Terminated: ok {rc=0} 02:19:16.373901 --- ParallelTerminationStrategy: PID 12933 died... 02:19:16.393825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Terminated: ok {rc=0} 02:19:16.442636 --- ParallelTerminationStrategy: PID 12936 died... 02:19:16.462663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Terminated: ok {rc=0} 02:19:16.552528 bus /sierra_3: Setting Powered False 02:19:17.650542 bus /sierra_3: Setting Powered False 02:19:18.766694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:19:19.914501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:19.926171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:19:19.993510 tst mo_mt_call_osmux.py: using LAC 25305 02:19:20.122243 tst mo_mt_call_osmux.py: using RAC 60 02:19:20.245263 tst mo_mt_call_osmux.py: using CellId 25305 02:19:20.367811 tst mo_mt_call_osmux.py: using BVCI 25306 02:19:20.481665 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:20.492718 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:20.503617 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:20.514830 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:20.526047 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:20.536787 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:20.652726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:20.774170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:21.291511 run create_hlr_db(pid=12939): Launched 02:19:21.426710 bus /sierra_2: Setting Powered False 02:19:22.491631 run create_hlr_db(pid=12939): Terminated: ok {rc=0} 02:19:22.953391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Launched 02:19:23.287417 run osmo-hlr_10.42.42.2(pid=12942): Launched 02:19:23.413957 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:23.984294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Launched 02:19:24.317155 run osmo-stp_10.42.42.5(pid=12945): Launched 02:19:24.442914 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:25.040359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Launched 02:19:25.373767 run osmo-msc_10.42.42.6(pid=12948): Launched 02:19:25.560915 run osmo-stp_10.42.42.5(pid=12945): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] 02:19:25.700399 run osmo-stp_10.42.42.5(pid=12945): stdout: | (launched: 2022-12-10_02:19:24.255295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:25.840648 run osmo-stp_10.42.42.5(pid=12945): stderr: | [0;m[38;5;43m20221210021924451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021924451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021924452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021924452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021924452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021924453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021924453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:25.979757 run osmo-stp_10.42.42.5(pid=12945): stdout: | (launched: 2022-12-10_02:19:24.255295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:26.111208 run osmo-stp_10.42.42.5(pid=12945): stderr: | [0;m[38;5;43m20221210021924451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021924451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021924452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021924452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021924452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021924453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021924453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:26.268618 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12945): Process ended prematurely: osmo-stp_10.42.42.5(pid=12945) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:19:26.278335 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:19:26.306255 run osmo-hlr_10.42.42.2(pid=12942): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12942)] 02:19:26.356338 run osmo-hlr_10.42.42.2(pid=12942): stdout: | (launched: 2022-12-10_02:19:23.225071) 02:19:26.408405 run osmo-hlr_10.42.42.2(pid=12942): stderr: | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021923428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021923455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021923466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021923466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021923467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:26.480698 run osmo-msc_10.42.42.6(pid=12948): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12948)] 02:19:26.530728 run osmo-msc_10.42.42.6(pid=12948): stdout: | (launched: 2022-12-10_02:19:25.311423) 02:19:26.582195 run osmo-msc_10.42.42.6(pid=12948): stderr: | [0;m[38;5;43m20221210021925638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021925639 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71ae8e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021925639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021925639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021925639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021925639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021925641 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021925641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021925641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021925641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:26.634122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Terminating (SIGTERM) 02:19:26.675754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Terminating (SIGTERM) 02:19:26.717269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Terminating (SIGTERM) 02:19:26.759210 --- ParallelTerminationStrategy: PID 12941 died... 02:19:26.779391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Terminated: ok {rc=0} 02:19:26.825882 --- ParallelTerminationStrategy: PID 12944 died... 02:19:26.845445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Terminated: ok {rc=0} 02:19:26.891732 --- ParallelTerminationStrategy: PID 12947 died... 02:19:26.911400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Terminated: ok {rc=0} 02:19:26.998179 bus /sierra_3: Setting Powered False 02:19:28.097117 bus /sierra_3: Setting Powered False 02:19:29.216730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:19:30.456700 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:30.463488 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:19:30.484529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:19:30.512407 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:19:30.566714 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:19:30.588013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:19:30.615258 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:19:31.190796 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:19:31.244209 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.256322 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:19:31.325573 tst mo_mt_call.py: using LAC 25306 02:19:31.485226 tst mo_mt_call.py: using RAC 61 02:19:31.616318 tst mo_mt_call.py: using CellId 25306 02:19:31.742717 tst mo_mt_call.py: using BVCI 25307 02:19:31.866247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.878249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.890906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.903331 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.915140 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:31.926926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:32.054347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:32.202988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:32.731369 run create_hlr_db(pid=12953): Launched 02:19:32.866843 bus /sierra_2: Setting Powered False 02:19:33.931576 run create_hlr_db(pid=12953): Terminated: ok {rc=0} 02:19:34.392468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Launched 02:19:34.725041 run osmo-hlr_10.42.42.2(pid=12956): Launched 02:19:34.850829 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:35.422314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Launched 02:19:35.755765 run osmo-stp_10.42.42.5(pid=12959): Launched 02:19:35.881624 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:36.482028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Launched 02:19:36.814493 run osmo-msc_10.42.42.6(pid=12962): Launched 02:19:36.998885 run osmo-stp_10.42.42.5(pid=12959): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] 02:19:37.138146 run osmo-stp_10.42.42.5(pid=12959): stdout: | (launched: 2022-12-10_02:19:35.693583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:37.278453 run osmo-stp_10.42.42.5(pid=12959): stderr: | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021935892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:37.417375 run osmo-stp_10.42.42.5(pid=12959): stdout: | (launched: 2022-12-10_02:19:35.693583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:37.549106 run osmo-stp_10.42.42.5(pid=12959): stderr: | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021935891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021935892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021935892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:37.705667 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12959): Process ended prematurely: osmo-stp_10.42.42.5(pid=12959) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:19:37.715078 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:19:37.742831 run osmo-hlr_10.42.42.2(pid=12956): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12956)] 02:19:37.792811 run osmo-hlr_10.42.42.2(pid=12956): stdout: | (launched: 2022-12-10_02:19:34.663145) 02:19:37.844539 run osmo-hlr_10.42.42.2(pid=12956): stderr: | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021934867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021934880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021934889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021934889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021934889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:37.916750 run osmo-msc_10.42.42.6(pid=12962): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12962)] 02:19:37.967165 run osmo-msc_10.42.42.6(pid=12962): stdout: | (launched: 2022-12-10_02:19:36.752389) 02:19:38.019094 run osmo-msc_10.42.42.6(pid=12962): stderr: | [0;m[38;5;43m20221210021937080 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021937080 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3eb977bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021937080 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021937080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021937080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021937080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021937082 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021937083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021937083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021937083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:38.071322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Terminating (SIGTERM) 02:19:38.113112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Terminating (SIGTERM) 02:19:38.154923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Terminating (SIGTERM) 02:19:38.197179 --- ParallelTerminationStrategy: PID 12955 died... 02:19:38.217327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12955): Terminated: ok {rc=0} 02:19:38.264073 --- ParallelTerminationStrategy: PID 12958 died... 02:19:38.283892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12958): Terminated: ok {rc=0} 02:19:38.330292 --- ParallelTerminationStrategy: PID 12961 died... 02:19:38.349960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12961): Terminated: ok {rc=0} 02:19:38.438144 bus /sierra_3: Setting Powered False 02:19:39.538591 bus /sierra_3: Setting Powered False 02:19:40.654576 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:19:41.804701 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:41.816717 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:19:41.877449 tst mo_mt_call_osmux.py: using LAC 25307 02:19:42.008774 tst mo_mt_call_osmux.py: using RAC 62 02:19:42.135870 tst mo_mt_call_osmux.py: using CellId 25307 02:19:42.260623 tst mo_mt_call_osmux.py: using BVCI 25308 02:19:42.374617 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:42.385929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:42.396886 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:42.408604 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:42.420140 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:42.431960 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:42.553429 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:42.669869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:43.148818 run create_hlr_db(pid=12964): Launched 02:19:43.265226 bus /sierra_2: Setting Powered False 02:19:44.326600 run create_hlr_db(pid=12964): Terminated: ok {rc=0} 02:19:44.776536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12966): Launched 02:19:45.106412 run osmo-hlr_10.42.42.2(pid=12967): Launched 02:19:45.230889 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:45.800684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12969): Launched 02:19:46.154880 run osmo-stp_10.42.42.5(pid=12970): Launched 02:19:46.437935 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:47.042082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12972): Launched 02:19:47.386348 run osmo-msc_10.42.42.6(pid=12973): Launched 02:19:47.568316 run osmo-stp_10.42.42.5(pid=12970): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12970)] 02:19:47.705725 run osmo-stp_10.42.42.5(pid=12970): stdout: | (launched: 2022-12-10_02:19:46.085032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:47.843878 run osmo-stp_10.42.42.5(pid=12970): stderr: | [0;m[38;5;43m20221210021946293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021946293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021946294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021946294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021946296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021946297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021946297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:47.981560 run osmo-stp_10.42.42.5(pid=12970): stdout: | (launched: 2022-12-10_02:19:46.085032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:48.110787 run osmo-stp_10.42.42.5(pid=12970): stderr: | [0;m[38;5;43m20221210021946293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021946293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021946294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021946294 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021946296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021946297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021946297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:48.265398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12970): Process ended prematurely: osmo-stp_10.42.42.5(pid=12970) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12970)] [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:19:48.274802 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:19:48.302529 run osmo-hlr_10.42.42.2(pid=12967): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12967)] 02:19:48.352399 run osmo-hlr_10.42.42.2(pid=12967): stdout: | (launched: 2022-12-10_02:19:45.042835) 02:19:48.404846 run osmo-hlr_10.42.42.2(pid=12967): stderr: | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021945244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021945257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021945265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021945266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021945266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:48.477147 run osmo-msc_10.42.42.6(pid=12973): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12973)] 02:19:48.527154 run osmo-msc_10.42.42.6(pid=12973): stdout: | (launched: 2022-12-10_02:19:47.320343) 02:19:48.578653 run osmo-msc_10.42.42.6(pid=12973): stderr: | [0;m[38;5;43m20221210021947653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021947653 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72c86bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021947653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021947653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021947653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021947654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021947655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021947656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021947656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021947656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:48.630522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12966): Terminating (SIGTERM) 02:19:48.671925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12969): Terminating (SIGTERM) 02:19:48.713456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12972): Terminating (SIGTERM) 02:19:48.755333 --- ParallelTerminationStrategy: PID 12966 died... 02:19:48.775352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12966): Terminated: ok {rc=0} 02:19:48.821284 --- ParallelTerminationStrategy: PID 12969 died... 02:19:48.841186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12969): Terminated: ok {rc=0} 02:19:48.887142 --- ParallelTerminationStrategy: PID 12972 died... 02:19:48.906737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12972): Terminated: ok {rc=0} 02:19:48.994297 bus /sierra_3: Setting Powered False 02:19:50.093811 bus /sierra_3: Setting Powered False 02:19:51.210184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:19:52.453695 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:52.460654 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:19:52.481464 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:19:52.508672 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:19:52.561643 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:19:52.582506 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:19:52.609385 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:19:53.161763 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:19:53.213601 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.225106 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:19:53.282264 tst mo_mt_call.py: using LAC 25308 02:19:53.412291 tst mo_mt_call.py: using RAC 63 02:19:53.539729 tst mo_mt_call.py: using CellId 25308 02:19:53.666912 tst mo_mt_call.py: using BVCI 25309 02:19:53.778585 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.790156 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.801261 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.812528 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.823996 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:19:53.835315 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:19:53.956711 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:19:54.073852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:54.547015 run create_hlr_db(pid=12978): Launched 02:19:54.665649 bus /sierra_2: Setting Powered False 02:19:55.726461 run create_hlr_db(pid=12978): Terminated: ok {rc=0} 02:19:56.150466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Launched 02:19:56.455142 run osmo-hlr_10.42.42.2(pid=12981): Launched 02:19:56.572291 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:57.109454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Launched 02:19:57.416051 run osmo-stp_10.42.42.5(pid=12984): Launched 02:19:57.535588 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:58.089280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Launched 02:19:58.395071 run osmo-msc_10.42.42.6(pid=12987): Launched 02:19:58.567917 run osmo-stp_10.42.42.5(pid=12984): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] 02:19:58.698231 run osmo-stp_10.42.42.5(pid=12984): stdout: | (launched: 2022-12-10_02:19:57.359923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:58.828442 run osmo-stp_10.42.42.5(pid=12984): stderr: | [0;m[38;5;43m20221210021957532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021957532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021957533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021957533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:58.956298 run osmo-stp_10.42.42.5(pid=12984): stdout: | (launched: 2022-12-10_02:19:57.359923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:59.077412 run osmo-stp_10.42.42.5(pid=12984): stderr: | [0;m[38;5;43m20221210021957532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210021957532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210021957533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210021957533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210021957534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:59.222667 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12984): Process ended prematurely: osmo-stp_10.42.42.5(pid=12984) [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:19:59.231575 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:19:59.258785 run osmo-hlr_10.42.42.2(pid=12981): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12981)] 02:19:59.306974 run osmo-hlr_10.42.42.2(pid=12981): stdout: | (launched: 2022-12-10_02:19:56.399555) 02:19:59.356619 run osmo-hlr_10.42.42.2(pid=12981): stderr: | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210021956574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210021956586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210021956594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210021956594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210021956594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:59.425647 run osmo-msc_10.42.42.6(pid=12987): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12987)] 02:19:59.473684 run osmo-msc_10.42.42.6(pid=12987): stdout: | (launched: 2022-12-10_02:19:58.339174) 02:19:59.522834 run osmo-msc_10.42.42.6(pid=12987): stderr: | [0;m[38;5;43m20221210021958612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210021958612 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc54b6d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210021958613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210021958613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210021958613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210021958613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210021958615 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210021958615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210021958615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210021958615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:59.572844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Terminating (SIGTERM) 02:19:59.612607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Terminating (SIGTERM) 02:19:59.652443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Terminating (SIGTERM) 02:19:59.693070 --- ParallelTerminationStrategy: PID 12980 died... 02:19:59.712244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12980): Terminated: ok {rc=0} 02:19:59.757274 --- ParallelTerminationStrategy: PID 12983 died... 02:19:59.776006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12983): Terminated: ok {rc=0} 02:19:59.820813 --- ParallelTerminationStrategy: PID 12986 died... 02:19:59.839811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12986): Terminated: ok {rc=0} 02:19:59.925620 bus /sierra_3: Setting Powered False 02:20:01.030240 bus /sierra_3: Setting Powered False 02:20:02.161658 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:20:03.306344 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.318044 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:20:03.374611 tst mo_mt_call_osmux.py: using LAC 25309 02:20:03.497443 tst mo_mt_call_osmux.py: using RAC 64 02:20:03.630696 tst mo_mt_call_osmux.py: using CellId 25309 02:20:03.759715 tst mo_mt_call_osmux.py: using BVCI 25310 02:20:03.879178 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.890949 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.902651 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.914389 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.925973 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:03.937586 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:04.057214 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:04.174924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:04.649784 run create_hlr_db(pid=12993): Launched 02:20:04.767505 bus /sierra_2: Setting Powered False 02:20:05.828213 run create_hlr_db(pid=12993): Terminated: ok {rc=0} 02:20:06.274855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12995): Launched 02:20:06.603661 run osmo-hlr_10.42.42.2(pid=12996): Launched 02:20:06.728657 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:07.293657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12998): Launched 02:20:07.623150 run osmo-stp_10.42.42.5(pid=12999): Launched 02:20:07.748548 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:08.341162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13001): Launched 02:20:08.670312 run osmo-msc_10.42.42.6(pid=13002): Launched 02:20:08.853135 run osmo-stp_10.42.42.5(pid=12999): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12999)] 02:20:08.990938 run osmo-stp_10.42.42.5(pid=12999): stdout: | (launched: 2022-12-10_02:20:07.563635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:09.128811 run osmo-stp_10.42.42.5(pid=12999): stderr: | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022007757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022007757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022007758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022007758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:09.266380 run osmo-stp_10.42.42.5(pid=12999): stdout: | (launched: 2022-12-10_02:20:07.563635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:09.396563 run osmo-stp_10.42.42.5(pid=12999): stderr: | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022007756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022007757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022007757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022007758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022007758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:09.553078 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12999): Process ended prematurely: osmo-stp_10.42.42.5(pid=12999) [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12999)] [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:20:09.562642 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:20:09.590755 run osmo-hlr_10.42.42.2(pid=12996): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12996)] 02:20:09.641318 run osmo-hlr_10.42.42.2(pid=12996): stdout: | (launched: 2022-12-10_02:20:06.544087) 02:20:09.693412 run osmo-hlr_10.42.42.2(pid=12996): stderr: | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022006743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022006763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022006771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022006771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022006771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:09.765904 run osmo-msc_10.42.42.6(pid=13002): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13002)] 02:20:09.815954 run osmo-msc_10.42.42.6(pid=13002): stdout: | (launched: 2022-12-10_02:20:08.610894) 02:20:09.867464 run osmo-msc_10.42.42.6(pid=13002): stderr: | [0;m[38;5;43m20221210022008935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022008935 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd640c8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022008935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022008935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022008935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022008936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022008937 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022008938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022008938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022008938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:09.919291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12995): Terminating (SIGTERM) 02:20:09.961006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12998): Terminating (SIGTERM) 02:20:10.002755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13001): Terminating (SIGTERM) 02:20:10.044810 --- ParallelTerminationStrategy: PID 12995 died... 02:20:10.065085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12995): Terminated: ok {rc=0} 02:20:10.111547 --- ParallelTerminationStrategy: PID 12998 died... 02:20:10.131195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12998): Terminated: ok {rc=0} 02:20:10.177537 --- ParallelTerminationStrategy: PID 13001 died... 02:20:10.197236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13001): Terminated: ok {rc=0} 02:20:10.284444 bus /sierra_3: Setting Powered False 02:20:11.382418 bus /sierra_3: Setting Powered False 02:20:12.497632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:20:13.734033 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:13.739963 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:20:13.761320 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:20:13.788497 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:20:13.841886 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:20:13.863076 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:20:13.890549 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:20:14.441053 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:20:14.493914 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:14.505487 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:20:14.564112 tst mo_mt_call.py: using LAC 25310 02:20:14.695698 tst mo_mt_call.py: using RAC 65 02:20:14.826271 tst mo_mt_call.py: using CellId 25310 02:20:14.946670 tst mo_mt_call.py: using BVCI 25311 02:20:15.059842 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:15.070972 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:15.081812 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:15.092777 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:15.103865 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:15.114873 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:15.232459 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:15.352392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:15.883751 run create_hlr_db(pid=13007): Launched 02:20:16.066184 bus /sierra_2: Setting Powered False 02:20:17.125401 run create_hlr_db(pid=13007): Terminated: ok {rc=0} 02:20:17.596057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13009): Launched 02:20:17.902762 run osmo-hlr_10.42.42.2(pid=13010): Launched 02:20:18.020351 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:18.545565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13012): Launched 02:20:18.853364 run osmo-stp_10.42.42.5(pid=13013): Launched 02:20:18.971735 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:19.525388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13015): Launched 02:20:19.832933 run osmo-msc_10.42.42.6(pid=13016): Launched 02:20:20.006118 run osmo-stp_10.42.42.5(pid=13013): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13013)] 02:20:20.136309 run osmo-stp_10.42.42.5(pid=13013): stdout: | (launched: 2022-12-10_02:20:18.797439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:20.266412 run osmo-stp_10.42.42.5(pid=13013): stderr: | [0;m[38;5;43m20221210022018967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022018967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022018968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022018968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022018968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022018969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022018969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:20.394416 run osmo-stp_10.42.42.5(pid=13013): stdout: | (launched: 2022-12-10_02:20:18.797439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:20.515906 run osmo-stp_10.42.42.5(pid=13013): stderr: | [0;m[38;5;43m20221210022018967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022018967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022018968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022018968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022018968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022018969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022018969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:20.660897 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13013): Process ended prematurely: osmo-stp_10.42.42.5(pid=13013) [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13013)] [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:20:20.669724 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:20:20.696758 run osmo-hlr_10.42.42.2(pid=13010): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13010)] 02:20:20.745073 run osmo-hlr_10.42.42.2(pid=13010): stdout: | (launched: 2022-12-10_02:20:17.846816) 02:20:20.795038 run osmo-hlr_10.42.42.2(pid=13010): stderr: | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022018024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022018041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022018049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022018049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022018049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:20.864835 run osmo-msc_10.42.42.6(pid=13016): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13016)] 02:20:20.913567 run osmo-msc_10.42.42.6(pid=13016): stdout: | (launched: 2022-12-10_02:20:19.776496) 02:20:20.963632 run osmo-msc_10.42.42.6(pid=13016): stderr: | [0;m[38;5;43m20221210022020046 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022020046 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4592759c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022020046 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022020046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022020046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022020046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022020048 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022020049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022020049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022020049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:21.013926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13009): Terminating (SIGTERM) 02:20:21.053925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13012): Terminating (SIGTERM) 02:20:21.093960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13015): Terminating (SIGTERM) 02:20:21.134373 --- ParallelTerminationStrategy: PID 13009 died... 02:20:21.153659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13009): Terminated: ok {rc=0} 02:20:21.198600 --- ParallelTerminationStrategy: PID 13012 died... 02:20:21.217522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13012): Terminated: ok {rc=0} 02:20:21.262024 --- ParallelTerminationStrategy: PID 13015 died... 02:20:21.280541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13015): Terminated: ok {rc=0} 02:20:21.367664 bus /sierra_3: Setting Powered False 02:20:22.468451 bus /sierra_3: Setting Powered False 02:20:23.584425 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:20:24.732431 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:24.743939 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:20:24.824132 tst mo_mt_call_osmux.py: using LAC 25311 02:20:24.953622 tst mo_mt_call_osmux.py: using RAC 66 02:20:25.081709 tst mo_mt_call_osmux.py: using CellId 25311 02:20:25.213877 tst mo_mt_call_osmux.py: using BVCI 25312 02:20:25.333484 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:25.345119 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:25.356247 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:25.367619 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:25.378868 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:25.390203 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:25.506832 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:25.626307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:26.135376 run create_hlr_db(pid=13018): Launched 02:20:26.268470 bus /sierra_2: Setting Powered False 02:20:27.332777 run create_hlr_db(pid=13018): Terminated: ok {rc=0} 02:20:27.787757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13020): Launched 02:20:28.116069 run osmo-hlr_10.42.42.2(pid=13021): Launched 02:20:28.241887 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:28.808929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13023): Launched 02:20:29.135780 run osmo-stp_10.42.42.5(pid=13024): Launched 02:20:29.260833 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:29.857236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13026): Launched 02:20:30.185059 run osmo-msc_10.42.42.6(pid=13027): Launched 02:20:30.368190 run osmo-stp_10.42.42.5(pid=13024): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13024)] 02:20:30.506683 run osmo-stp_10.42.42.5(pid=13024): stdout: | (launched: 2022-12-10_02:20:29.076261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:30.647494 run osmo-stp_10.42.42.5(pid=13024): stderr: | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022029269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:30.785190 run osmo-stp_10.42.42.5(pid=13024): stdout: | (launched: 2022-12-10_02:20:29.076261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:30.933208 run osmo-stp_10.42.42.5(pid=13024): stderr: | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022029269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022029269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022029272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:31.085114 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13024): Process ended prematurely: osmo-stp_10.42.42.5(pid=13024) [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13024)] [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:20:31.095083 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:20:31.125483 run osmo-hlr_10.42.42.2(pid=13021): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13021)] 02:20:31.175872 run osmo-hlr_10.42.42.2(pid=13021): stdout: | (launched: 2022-12-10_02:20:28.056439) 02:20:31.229423 run osmo-hlr_10.42.42.2(pid=13021): stderr: | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022028255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022028268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022028276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022028276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022028276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:31.301650 run osmo-msc_10.42.42.6(pid=13027): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13027)] 02:20:31.352846 run osmo-msc_10.42.42.6(pid=13027): stdout: | (launched: 2022-12-10_02:20:30.125763) 02:20:31.405055 run osmo-msc_10.42.42.6(pid=13027): stderr: | [0;m[38;5;43m20221210022030451 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022030451 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f283ed45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022030451 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022030451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022030452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022030452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022030453 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022030454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022030454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022030454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:31.459532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13020): Terminating (SIGTERM) 02:20:31.502779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13023): Terminating (SIGTERM) 02:20:31.547223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13026): Terminating (SIGTERM) 02:20:31.592803 --- ParallelTerminationStrategy: PID 13020 died... 02:20:31.613056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13020): Terminated: ok {rc=0} 02:20:31.663108 --- ParallelTerminationStrategy: PID 13023 died... 02:20:31.682868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13023): Terminated: ok {rc=0} 02:20:31.730769 --- ParallelTerminationStrategy: PID 13026 died... 02:20:31.750483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13026): Terminated: ok {rc=0} 02:20:31.840315 bus /sierra_3: Setting Powered False 02:20:32.942490 bus /sierra_3: Setting Powered False 02:20:34.057538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:oc2g --------------------------------------------------------------------- 02:20:35.289579 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:35.293818 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 02:20:35.314031 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 02:20:35.340907 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 02:20:35.426519 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 02:20:35.447213 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 02:20:35.474223 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 02:20:36.054547 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 02:20:36.059429 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.069950 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:20:36.105380 tst emergency_mo_mt_call.py: using LAC 25312 02:20:36.225202 tst emergency_mo_mt_call.py: using RAC 67 02:20:36.343717 tst emergency_mo_mt_call.py: using CellId 25312 02:20:36.462808 tst emergency_mo_mt_call.py: using BVCI 25313 02:20:36.573373 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.583921 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.594375 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.604882 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.615489 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:36.626092 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:36.746496 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:36.865468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:37.365177 run create_hlr_db(pid=13033): Launched 02:20:37.497466 bus /sierra_2: Setting Powered False 02:20:38.561892 run create_hlr_db(pid=13033): Terminated: ok {rc=0} 02:20:38.991214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13035): Launched 02:20:39.292929 run osmo-hlr_10.42.42.2(pid=13036): Launched 02:20:39.408771 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:39.939375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13038): Launched 02:20:40.240255 run osmo-stp_10.42.42.5(pid=13039): Launched 02:20:40.364305 tst emergency_mo_mt_call.py: using MSISDN 7504 02:20:40.518027 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:41.058883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13041): Launched 02:20:41.359248 run osmo-msc_10.42.42.6(pid=13042): Launched 02:20:41.527558 run osmo-stp_10.42.42.5(pid=13039): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13039)] 02:20:41.655229 run osmo-stp_10.42.42.5(pid=13039): stdout: | (launched: 2022-12-10_02:20:40.185363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:41.783918 run osmo-stp_10.42.42.5(pid=13039): stderr: | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022040354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:41.909981 run osmo-stp_10.42.42.5(pid=13039): stdout: | (launched: 2022-12-10_02:20:40.185363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:42.029551 run osmo-stp_10.42.42.5(pid=13039): stderr: | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022040353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022040354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022040356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:42.172728 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13039): Process ended prematurely: osmo-stp_10.42.42.5(pid=13039) [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13039)] [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py:19] 02:20:42.181177 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 02:20:42.207583 run osmo-hlr_10.42.42.2(pid=13036): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13036)] 02:20:42.255887 run osmo-hlr_10.42.42.2(pid=13036): stdout: | (launched: 2022-12-10_02:20:39.238571) 02:20:42.305640 run osmo-hlr_10.42.42.2(pid=13036): stderr: | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022039410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022039422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022039431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022039431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022039431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:42.374993 run osmo-msc_10.42.42.6(pid=13042): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13042)] 02:20:42.423061 run osmo-msc_10.42.42.6(pid=13042): stdout: | (launched: 2022-12-10_02:20:41.304223) 02:20:42.472570 run osmo-msc_10.42.42.6(pid=13042): stderr: | [0;m[38;5;43m20221210022041578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022041578 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0699d03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022041578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022041578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022041578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022041579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022041581 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022041581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022041582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022041582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:42.522440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13035): Terminating (SIGTERM) 02:20:42.562356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13038): Terminating (SIGTERM) 02:20:42.602471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13041): Terminating (SIGTERM) 02:20:42.642981 --- ParallelTerminationStrategy: PID 13035 died... 02:20:42.662271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13035): Terminated: ok {rc=0} 02:20:42.707091 --- ParallelTerminationStrategy: PID 13038 died... 02:20:42.726074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13038): Terminated: ok {rc=0} 02:20:42.770625 --- ParallelTerminationStrategy: PID 13041 died... 02:20:42.789340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13041): Terminated: ok {rc=0} 02:20:42.873471 bus /sierra_3: Setting Powered False 02:20:43.971035 bus /sierra_3: Setting Powered False 02:20:45.086882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 02:20:46.177642 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.192310 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:20:46.238729 tst emergency_preemptive_call.py: using LAC 25313 02:20:46.368651 tst emergency_preemptive_call.py: using RAC 68 02:20:46.489702 tst emergency_preemptive_call.py: using CellId 25313 02:20:46.609247 tst emergency_preemptive_call.py: using BVCI 25314 02:20:46.730410 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.742113 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.753666 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.765726 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.778257 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:46.789645 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:46.912570 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:47.062211 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:47.185256 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:47.322824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:47.826720 run create_hlr_db(pid=13044): Launched 02:20:47.959043 bus /sierra_2: Setting Powered False 02:20:49.023234 run create_hlr_db(pid=13044): Terminated: ok {rc=0} 02:20:49.472541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Launched 02:20:49.794456 run osmo-hlr_10.42.42.2(pid=13047): Launched 02:20:49.918735 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:50.471002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Launched 02:20:50.792707 run osmo-stp_10.42.42.5(pid=13050): Launched 02:20:50.924753 tst emergency_preemptive_call.py: using MSISDN 7505 02:20:51.088828 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:51.667097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13052): Launched 02:20:51.989469 run osmo-msc_10.42.42.6(pid=13053): Launched 02:20:52.170343 run osmo-stp_10.42.42.5(pid=13050): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] 02:20:52.306461 run osmo-stp_10.42.42.5(pid=13050): stdout: | (launched: 2022-12-10_02:20:50.734427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:52.443630 run osmo-stp_10.42.42.5(pid=13050): stderr: | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022050928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:52.579932 run osmo-stp_10.42.42.5(pid=13050): stdout: | (launched: 2022-12-10_02:20:50.734427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:52.707803 run osmo-stp_10.42.42.5(pid=13050): stderr: | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022050927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022050928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022050928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:52.861180 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13050): Process ended prematurely: osmo-stp_10.42.42.5(pid=13050) [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py:32] 02:20:52.869973 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 02:20:52.897322 run osmo-hlr_10.42.42.2(pid=13047): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13047)] 02:20:52.947284 run osmo-hlr_10.42.42.2(pid=13047): stdout: | (launched: 2022-12-10_02:20:49.736077) 02:20:52.998694 run osmo-hlr_10.42.42.2(pid=13047): stderr: | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022049935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022049947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022049955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022049955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022049955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:53.070722 run osmo-msc_10.42.42.6(pid=13053): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13053)] 02:20:53.120308 run osmo-msc_10.42.42.6(pid=13053): stdout: | (launched: 2022-12-10_02:20:51.930791) 02:20:53.171687 run osmo-msc_10.42.42.6(pid=13053): stderr: | [0;m[38;5;43m20221210022052255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022052256 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe6949ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022052256 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022052256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022052256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022052256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022052258 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022052258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022052259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022052259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:53.223262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Terminating (SIGTERM) 02:20:53.264499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Terminating (SIGTERM) 02:20:53.305829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13052): Terminating (SIGTERM) 02:20:53.347524 --- ParallelTerminationStrategy: PID 13046 died... 02:20:53.367216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Terminated: ok {rc=0} 02:20:53.413029 --- ParallelTerminationStrategy: PID 13049 died... 02:20:53.432844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Terminated: ok {rc=0} 02:20:53.479229 --- ParallelTerminationStrategy: PID 13052 died... 02:20:53.499043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13052): Terminated: ok {rc=0} 02:20:53.586621 bus /sierra_9: Setting Powered False 02:20:54.687232 bus /sierra_9: Setting Powered False 02:20:55.804234 bus /sierra_8: Setting Powered False 02:20:56.900895 bus /sierra_8: Setting Powered False 02:20:58.015647 bus /sierra_3: Setting Powered False 02:20:59.115976 bus /sierra_3: Setting Powered False 02:21:00.231800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:oc2g --------------------------------------------------------------------- 02:21:01.499588 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:21:01.504386 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 02:21:01.529975 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 02:21:01.572827 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 02:21:01.664061 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 02:21:01.686527 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 02:21:01.729033 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 02:21:02.317846 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 02:21:02.369929 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.380256 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:02.415151 tst cs_paging_gprs_active.py: using LAC 25314 02:21:02.536440 tst cs_paging_gprs_active.py: using RAC 69 02:21:02.658590 tst cs_paging_gprs_active.py: using CellId 25314 02:21:02.781334 tst cs_paging_gprs_active.py: using BVCI 25315 02:21:02.895061 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.905612 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.915911 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.926469 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.936604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.947247 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.957862 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.968288 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:02.978893 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:03.094494 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:03.214588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:21:03.437045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:03.766562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13058): Launched 02:21:04.052647 run iperf3-srv_10.42.42.10(pid=13059): Launched 02:21:04.177372 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:21:04.399063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:04.728672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Launched 02:21:05.013939 run iperf3-srv_10.42.42.10(pid=13061): Launched 02:21:05.138390 tst cs_paging_gprs_active.py:38: start network... 02:21:05.359381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:05.868797 run create_hlr_db(pid=13062): Launched 02:21:06.004193 bus /sierra_2: Setting Powered False 02:21:07.068130 run create_hlr_db(pid=13062): Terminated: ok {rc=0} 02:21:07.521512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13064): Launched 02:21:07.850690 run osmo-hlr_10.42.42.2(pid=13065): Launched 02:21:07.975669 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:08.537091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13067): Launched 02:21:08.864481 run osmo-stp_10.42.42.5(pid=13068): Launched 02:21:08.990466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:09.554140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13070): Launched 02:21:09.679596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:09.955522 run patchelf(pid=13071): Launched 02:21:10.138680 run osmo-stp_10.42.42.5(pid=13068): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13068)] 02:21:10.276497 run osmo-stp_10.42.42.5(pid=13068): stdout: | (launched: 2022-12-10_02:21:08.804679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:10.416245 run osmo-stp_10.42.42.5(pid=13068): stderr: | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022108998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:10.555992 run osmo-stp_10.42.42.5(pid=13068): stdout: | (launched: 2022-12-10_02:21:08.804679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:10.690269 run osmo-stp_10.42.42.5(pid=13068): stderr: | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022108997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022108998 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022108998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:10.849510 run patchelf(pid=13071): Terminating (SIGINT) 02:21:11.032869 run patchelf(pid=13071): Terminated: ok {rc=0} 02:21:11.165621 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13068): Process ended prematurely: osmo-stp_10.42.42.5(pid=13068) [trial-2368↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13068)] [trial-2368↪gprs:oc2g↪cs_paging_gprs_active.py:38] 02:21:11.175675 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:21:11.204441 run osmo-hlr_10.42.42.2(pid=13065): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13065)] 02:21:11.254627 run osmo-hlr_10.42.42.2(pid=13065): stdout: | (launched: 2022-12-10_02:21:07.791006) 02:21:11.306283 run osmo-hlr_10.42.42.2(pid=13065): stderr: | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022107991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022108004 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022108013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022108013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022108013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:11.358364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13058): Terminating (SIGTERM) 02:21:11.400071 run iperf3-srv_10.42.42.10(pid=13059): Terminating (SIGTERM) 02:21:11.442095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Terminating (SIGTERM) 02:21:11.483823 run iperf3-srv_10.42.42.10(pid=13061): Terminating (SIGTERM) 02:21:11.525371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13064): Terminating (SIGTERM) 02:21:11.567036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13067): Terminating (SIGTERM) 02:21:11.609604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13070): Terminating (SIGTERM) 02:21:11.651604 --- ParallelTerminationStrategy: PID 13058 died... 02:21:11.671652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13058): Terminated: ok {rc=0} 02:21:11.717767 --- ParallelTerminationStrategy: PID 13059 died... 02:21:11.737172 run iperf3-srv_10.42.42.10(pid=13059): Terminated {rc=256} 02:21:11.783043 --- ParallelTerminationStrategy: PID 13060 died... 02:21:11.802472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Terminated: ok {rc=0} 02:21:11.848175 --- ParallelTerminationStrategy: PID 13061 died... 02:21:11.867797 run iperf3-srv_10.42.42.10(pid=13061): Terminated {rc=256} 02:21:11.913497 --- ParallelTerminationStrategy: PID 13064 died... 02:21:11.933157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13064): Terminated: ok {rc=0} 02:21:11.978793 --- ParallelTerminationStrategy: PID 13067 died... 02:21:11.998408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13067): Terminated: ok {rc=0} 02:21:12.044695 --- ParallelTerminationStrategy: PID 13070 died... 02:21:12.064430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13070): Terminated: ok {rc=0} 02:21:12.151559 bus /gobi_0: Setting Powered False 02:21:13.250151 bus /gobi_0: Setting Powered False 02:21:14.364918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g iperf3.py ---------------------------------------------- 02:21:15.515444 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:15.527064 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:15.562957 tst iperf3.py: using LAC 25315 02:21:15.690925 tst iperf3.py: using RAC 70 02:21:15.819733 tst iperf3.py: using CellId 25315 02:21:15.955321 tst iperf3.py: using BVCI 25316 02:21:16.080890 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.092911 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.104689 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.116708 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.128790 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.140892 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.153250 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.165497 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:16.177061 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:16.316071 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:21:16.593800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:16.939089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13072): Launched 02:21:17.241605 run iperf3-srv_10.42.42.10(pid=13073): Launched 02:21:17.377846 tst iperf3.py:8: start network... 02:21:17.599086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:18.105702 run create_hlr_db(pid=13074): Launched 02:21:18.239563 bus /gobi_6: Setting Powered False 02:21:19.303721 run create_hlr_db(pid=13074): Terminated: ok {rc=0} 02:21:19.740339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Launched 02:21:20.046488 run osmo-hlr_10.42.42.2(pid=13077): Launched 02:21:20.163562 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:20.700804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Launched 02:21:21.006892 run osmo-stp_10.42.42.5(pid=13080): Launched 02:21:21.124094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:21.651475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13082): Launched 02:21:21.769103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:22.028311 run patchelf(pid=13083): Launched 02:21:22.213933 run osmo-stp_10.42.42.5(pid=13080): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] 02:21:22.352811 run osmo-stp_10.42.42.5(pid=13080): stdout: | (launched: 2022-12-10_02:21:20.950764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:22.493538 run osmo-stp_10.42.42.5(pid=13080): stderr: | [0;m[38;5;43m20221210022121122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022121122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022121123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022121123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022121124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:22.634155 run osmo-stp_10.42.42.5(pid=13080): stdout: | (launched: 2022-12-10_02:21:20.950764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:22.769305 run osmo-stp_10.42.42.5(pid=13080): stderr: | [0;m[38;5;43m20221210022121122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022121122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022121123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022121123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022121124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:22.928614 run patchelf(pid=13083): Terminating (SIGINT) 02:21:23.112812 run patchelf(pid=13083): Terminated: ok {rc=0} 02:21:23.245191 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13080): Process ended prematurely: osmo-stp_10.42.42.5(pid=13080) [trial-2368↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] [trial-2368↪gprs:oc2g↪iperf3.py:8] 02:21:23.255383 tst iperf3.py:8: Test FAILED (7.8 sec) 02:21:23.283962 run osmo-hlr_10.42.42.2(pid=13077): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13077)] 02:21:23.334054 run osmo-hlr_10.42.42.2(pid=13077): stdout: | (launched: 2022-12-10_02:21:19.990515) 02:21:23.385997 run osmo-hlr_10.42.42.2(pid=13077): stderr: | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022120168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022120180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022120189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022120189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022120189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:23.438791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13072): Terminating (SIGTERM) 02:21:23.480905 run iperf3-srv_10.42.42.10(pid=13073): Terminating (SIGTERM) 02:21:23.522938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Terminating (SIGTERM) 02:21:23.564915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Terminating (SIGTERM) 02:21:23.606820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13082): Terminating (SIGTERM) 02:21:23.649319 --- ParallelTerminationStrategy: PID 13072 died... 02:21:23.669224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13072): Terminated: ok {rc=0} 02:21:23.715434 --- ParallelTerminationStrategy: PID 13073 died... 02:21:23.735383 run iperf3-srv_10.42.42.10(pid=13073): Terminated {rc=256} 02:21:23.781381 --- ParallelTerminationStrategy: PID 13076 died... 02:21:23.801198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Terminated: ok {rc=0} 02:21:23.847295 --- ParallelTerminationStrategy: PID 13079 died... 02:21:23.867009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Terminated: ok {rc=0} 02:21:23.913159 --- ParallelTerminationStrategy: PID 13082 died... 02:21:23.932584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13082): Terminated: ok {rc=0} 02:21:24.021580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g iperf3m4.py ---------------------------------------------- 02:21:25.173401 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.187724 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:25.222338 tst iperf3m4.py: using LAC 25316 02:21:25.350597 tst iperf3m4.py: using RAC 71 02:21:25.479442 tst iperf3m4.py: using CellId 25316 02:21:25.609946 tst iperf3m4.py: using BVCI 25317 02:21:25.730536 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.741655 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.752689 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.763558 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.774296 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.785005 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.795850 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.806642 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:25.817581 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:25.935081 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:26.059905 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:26.183550 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:26.300092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:21:26.507020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:26.816237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13084): Launched 02:21:27.084257 run iperf3-srv_10.42.42.10(pid=13085): Launched 02:21:27.200817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:21:27.406030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:27.713019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13086): Launched 02:21:27.979721 run iperf3-srv_10.42.42.10(pid=13087): Launched 02:21:28.095008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:21:28.298686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:28.604559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13088): Launched 02:21:28.870937 run iperf3-srv_10.42.42.10(pid=13089): Launched 02:21:28.986301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:21:29.190360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:29.496868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Launched 02:21:29.762436 run iperf3-srv_10.42.42.10(pid=13091): Launched 02:21:29.878360 tst iperf3m4.py:8: start network... 02:21:30.082070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:30.556066 run create_hlr_db(pid=13092): Launched 02:21:30.674722 bus /gobi_6: Setting Powered False 02:21:31.734522 run create_hlr_db(pid=13092): Terminated: ok {rc=0} 02:21:32.183939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Launched 02:21:32.505269 run osmo-hlr_10.42.42.2(pid=13095): Launched 02:21:32.624463 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:33.147917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Launched 02:21:33.454858 run osmo-stp_10.42.42.5(pid=13098): Launched 02:21:33.572931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:34.099964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Launched 02:21:34.218454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:34.477702 run patchelf(pid=13101): Launched 02:21:34.648569 run osmo-stp_10.42.42.5(pid=13098): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] 02:21:34.777564 run osmo-stp_10.42.42.5(pid=13098): stdout: | (launched: 2022-12-10_02:21:33.398939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:34.908021 run osmo-stp_10.42.42.5(pid=13098): stderr: | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022133569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:35.039047 run osmo-stp_10.42.42.5(pid=13098): stdout: | (launched: 2022-12-10_02:21:33.398939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:35.164279 run osmo-stp_10.42.42.5(pid=13098): stderr: | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022133568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022133569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022133571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:35.312901 run patchelf(pid=13101): Terminating (SIGINT) 02:21:35.484869 run patchelf(pid=13101): Terminated: ok {rc=0} 02:21:35.608484 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13098): Process ended prematurely: osmo-stp_10.42.42.5(pid=13098) [trial-2368↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] [trial-2368↪gprs:oc2g↪iperf3m4.py:8] 02:21:35.617879 tst iperf3m4.py:8: Test FAILED (10.5 sec) 02:21:35.645702 run osmo-hlr_10.42.42.2(pid=13095): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13095)] 02:21:35.693728 run osmo-hlr_10.42.42.2(pid=13095): stdout: | (launched: 2022-12-10_02:21:32.448520) 02:21:35.743099 run osmo-hlr_10.42.42.2(pid=13095): stderr: | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022132628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022132649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022132658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022132658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022132658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:35.793034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13084): Terminating (SIGTERM) 02:21:35.832546 run iperf3-srv_10.42.42.10(pid=13085): Terminating (SIGTERM) 02:21:35.872039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13086): Terminating (SIGTERM) 02:21:35.911694 run iperf3-srv_10.42.42.10(pid=13087): Terminating (SIGTERM) 02:21:35.951242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13088): Terminating (SIGTERM) 02:21:35.990880 run iperf3-srv_10.42.42.10(pid=13089): Terminating (SIGTERM) 02:21:36.030390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Terminating (SIGTERM) 02:21:36.070087 run iperf3-srv_10.42.42.10(pid=13091): Terminating (SIGTERM) 02:21:36.109715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Terminating (SIGTERM) 02:21:36.149400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Terminating (SIGTERM) 02:21:36.189143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Terminating (SIGTERM) 02:21:36.229519 --- ParallelTerminationStrategy: PID 13084 died... 02:21:36.248490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13084): Terminated: ok {rc=0} 02:21:36.293128 --- ParallelTerminationStrategy: PID 13085 died... 02:21:36.311748 run iperf3-srv_10.42.42.10(pid=13085): Terminated {rc=256} 02:21:36.355974 --- ParallelTerminationStrategy: PID 13086 died... 02:21:36.374647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13086): Terminated: ok {rc=0} 02:21:36.418646 --- ParallelTerminationStrategy: PID 13087 died... 02:21:36.437647 run iperf3-srv_10.42.42.10(pid=13087): Terminated {rc=256} 02:21:36.481653 --- ParallelTerminationStrategy: PID 13088 died... 02:21:36.500208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13088): Terminated: ok {rc=0} 02:21:36.544376 --- ParallelTerminationStrategy: PID 13089 died... 02:21:36.563054 run iperf3-srv_10.42.42.10(pid=13089): Terminated {rc=256} 02:21:36.607662 --- ParallelTerminationStrategy: PID 13090 died... 02:21:36.626312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13090): Terminated: ok {rc=0} 02:21:36.670322 --- ParallelTerminationStrategy: PID 13091 died... 02:21:36.688744 run iperf3-srv_10.42.42.10(pid=13091): Terminated {rc=256} 02:21:36.733107 --- ParallelTerminationStrategy: PID 13094 died... 02:21:36.751706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13094): Terminated: ok {rc=0} 02:21:36.795876 --- ParallelTerminationStrategy: PID 13097 died... 02:21:36.814599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13097): Terminated: ok {rc=0} 02:21:36.859322 --- ParallelTerminationStrategy: PID 13100 died... 02:21:36.877942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13100): Terminated: ok {rc=0} 02:21:36.964146 bus /gobi_4: Setting Powered False 02:21:38.064224 bus /gobi_4: Setting Powered False 02:21:39.179694 bus /gobi_1: Setting Powered False 02:21:40.278884 bus /gobi_1: Setting Powered False 02:21:41.393984 bus /gobi_0: Setting Powered False 02:21:42.492043 bus /gobi_0: Setting Powered False 02:21:43.608466 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g ping.py ---------------------------------------------- 02:21:44.712212 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.723569 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:44.759833 tst ping.py: using LAC 25317 02:21:44.886289 tst ping.py: using RAC 72 02:21:45.013707 tst ping.py: using CellId 25317 02:21:45.141753 tst ping.py: using BVCI 25318 02:21:45.260347 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.271307 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.282218 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.292886 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.303933 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.314739 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.325649 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.336223 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:45.451452 tst ping.py:19: start network... 02:21:45.653614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:46.131800 run create_hlr_db(pid=13102): Launched 02:21:46.287301 bus /gobi_6: Setting Powered False 02:21:47.347033 run create_hlr_db(pid=13102): Terminated: ok {rc=0} 02:21:47.787298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13104): Launched 02:21:48.110043 run osmo-hlr_10.42.42.2(pid=13105): Launched 02:21:48.233739 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:48.795869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13107): Launched 02:21:49.119677 run osmo-stp_10.42.42.5(pid=13108): Launched 02:21:49.242962 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:49.800923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13110): Launched 02:21:49.925182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:50.196603 run patchelf(pid=13111): Launched 02:21:50.377678 run osmo-stp_10.42.42.5(pid=13108): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13108)] 02:21:50.514842 run osmo-stp_10.42.42.5(pid=13108): stdout: | (launched: 2022-12-10_02:21:49.060784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:50.653157 run osmo-stp_10.42.42.5(pid=13108): stderr: | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022149253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:50.791522 run osmo-stp_10.42.42.5(pid=13108): stdout: | (launched: 2022-12-10_02:21:49.060784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:50.923644 run osmo-stp_10.42.42.5(pid=13108): stderr: | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022149252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022149253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022149255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:51.080165 run patchelf(pid=13111): Terminating (SIGINT) 02:21:51.261874 run patchelf(pid=13111): Terminated: ok {rc=0} 02:21:51.392112 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13108): Process ended prematurely: osmo-stp_10.42.42.5(pid=13108) [trial-2368↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13108)] [trial-2368↪gprs:oc2g↪ping.py:22] 02:21:51.401440 tst ping.py:22: Test FAILED (6.7 sec) 02:21:51.429803 run osmo-hlr_10.42.42.2(pid=13105): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13105)] 02:21:51.480459 run osmo-hlr_10.42.42.2(pid=13105): stdout: | (launched: 2022-12-10_02:21:48.051482) 02:21:51.532433 run osmo-hlr_10.42.42.2(pid=13105): stderr: | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022148250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022148262 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022148271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022148271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022148271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:51.584565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13104): Terminating (SIGTERM) 02:21:51.626656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13107): Terminating (SIGTERM) 02:21:51.668622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13110): Terminating (SIGTERM) 02:21:51.711120 --- ParallelTerminationStrategy: PID 13104 died... 02:21:51.731114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13104): Terminated: ok {rc=0} 02:21:51.777661 --- ParallelTerminationStrategy: PID 13107 died... 02:21:51.797654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13107): Terminated: ok {rc=0} 02:21:51.844186 --- ParallelTerminationStrategy: PID 13110 died... 02:21:51.864127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13110): Terminated: ok {rc=0} 02:21:51.953065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 02:21:53.039164 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.050448 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:53.087781 tst ping_idle_ping.py: using LAC 25318 02:21:53.209200 tst ping_idle_ping.py: using RAC 73 02:21:53.327611 tst ping_idle_ping.py: using CellId 25318 02:21:53.448942 tst ping_idle_ping.py: using BVCI 25319 02:21:53.558646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.569181 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.579531 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.590314 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.600874 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.611618 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.622519 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:53.633432 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:53.752664 tst ping_idle_ping.py:24: start network... 02:21:53.970890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:54.473517 run create_hlr_db(pid=13112): Launched 02:21:54.606836 bus /gobi_6: Setting Powered False 02:21:55.671052 run create_hlr_db(pid=13112): Terminated: ok {rc=0} 02:21:56.101105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13114): Launched 02:21:56.403113 run osmo-hlr_10.42.42.2(pid=13115): Launched 02:21:56.518673 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:57.049456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13117): Launched 02:21:57.351954 run osmo-stp_10.42.42.5(pid=13118): Launched 02:21:57.467132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:57.986149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13120): Launched 02:21:58.102511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:58.357338 run patchelf(pid=13121): Launched 02:21:58.527673 run osmo-stp_10.42.42.5(pid=13118): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13118)] 02:21:58.655722 run osmo-stp_10.42.42.5(pid=13118): stdout: | (launched: 2022-12-10_02:21:57.296724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:58.785375 run osmo-stp_10.42.42.5(pid=13118): stderr: | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022157468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:58.914949 run osmo-stp_10.42.42.5(pid=13118): stdout: | (launched: 2022-12-10_02:21:57.296724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:59.039038 run osmo-stp_10.42.42.5(pid=13118): stderr: | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022157467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022157468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022157468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:59.185880 run patchelf(pid=13121): Terminating (SIGINT) 02:21:59.356286 run patchelf(pid=13121): Terminated: ok {rc=0} 02:21:59.478965 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13118): Process ended prematurely: osmo-stp_10.42.42.5(pid=13118) [trial-2368↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13118)] [trial-2368↪gprs:oc2g↪ping_idle_ping.py:27] 02:21:59.488041 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:21:59.515607 run osmo-hlr_10.42.42.2(pid=13115): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13115)] 02:21:59.563803 run osmo-hlr_10.42.42.2(pid=13115): stdout: | (launched: 2022-12-10_02:21:56.347814) 02:21:59.613657 run osmo-hlr_10.42.42.2(pid=13115): stderr: | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022156525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022156538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022156549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022156549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022156549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:59.664253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13114): Terminating (SIGTERM) 02:21:59.704521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13117): Terminating (SIGTERM) 02:21:59.744783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13120): Terminating (SIGTERM) 02:21:59.785509 --- ParallelTerminationStrategy: PID 13114 died... 02:21:59.804879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13114): Terminated: ok {rc=0} 02:21:59.849914 --- ParallelTerminationStrategy: PID 13117 died... 02:21:59.868579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13117): Terminated: ok {rc=0} 02:21:59.913742 --- ParallelTerminationStrategy: PID 13120 died... 02:21:59.932594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13120): Terminated: ok {rc=0} 02:22:00.019445 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 02:22:01.320404 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:22:01.329081 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:22:01.353886 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:22:01.405474 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:22:01.501398 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:22:01.531776 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:22:01.580787 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:22:02.191827 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:22:02.246327 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.257503 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:02.297437 tst cs_paging_gprs_active.py: using LAC 25319 02:22:02.416555 tst cs_paging_gprs_active.py: using RAC 74 02:22:02.537694 tst cs_paging_gprs_active.py: using CellId 25319 02:22:02.659339 tst cs_paging_gprs_active.py: using BVCI 25320 02:22:02.769644 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.780512 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.791205 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.802479 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.813204 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.823897 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.834656 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.845764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:02.856707 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:02.976263 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:03.096108 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:22:03.313662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:03.636110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13125): Launched 02:22:03.914524 run iperf3-srv_10.42.42.10(pid=13126): Launched 02:22:04.035816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:22:04.251432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:04.573607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13127): Launched 02:22:04.853297 run iperf3-srv_10.42.42.10(pid=13128): Launched 02:22:04.974131 tst cs_paging_gprs_active.py:38: start network... 02:22:05.188936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:05.687940 run create_hlr_db(pid=13129): Launched 02:22:05.819657 bus /gobi_6: Setting Powered False 02:22:06.882459 run create_hlr_db(pid=13129): Terminated: ok {rc=0} 02:22:07.312071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Launched 02:22:07.614291 run osmo-hlr_10.42.42.2(pid=13132): Launched 02:22:07.729920 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:08.245650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Launched 02:22:08.548922 run osmo-stp_10.42.42.5(pid=13135): Launched 02:22:08.664884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:09.183553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13137): Launched 02:22:09.299938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:09.554562 run patchelf(pid=13138): Launched 02:22:09.722711 run osmo-stp_10.42.42.5(pid=13135): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] 02:22:09.850267 run osmo-stp_10.42.42.5(pid=13135): stdout: | (launched: 2022-12-10_02:22:08.493737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:09.979188 run osmo-stp_10.42.42.5(pid=13135): stderr: | [0;m[38;5;43m20221210022208665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022208665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022208666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022208666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022208666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022208667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022208667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:10.108227 run osmo-stp_10.42.42.5(pid=13135): stdout: | (launched: 2022-12-10_02:22:08.493737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:10.232263 run osmo-stp_10.42.42.5(pid=13135): stderr: | [0;m[38;5;43m20221210022208665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022208665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022208666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022208666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022208666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022208667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022208667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:10.379059 run patchelf(pid=13138): Terminating (SIGINT) 02:22:10.548477 run patchelf(pid=13138): Terminated: ok {rc=0} 02:22:10.670857 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13135): Process ended prematurely: osmo-stp_10.42.42.5(pid=13135) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] [trial-2368↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:22:10.680137 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:22:10.707613 run osmo-hlr_10.42.42.2(pid=13132): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13132)] 02:22:10.756061 run osmo-hlr_10.42.42.2(pid=13132): stdout: | (launched: 2022-12-10_02:22:07.559403) 02:22:10.805937 run osmo-hlr_10.42.42.2(pid=13132): stderr: | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022207737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022207750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022207760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022207761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022207761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:10.856611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13125): Terminating (SIGTERM) 02:22:10.896504 run iperf3-srv_10.42.42.10(pid=13126): Terminating (SIGTERM) 02:22:10.937678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13127): Terminating (SIGTERM) 02:22:10.977528 run iperf3-srv_10.42.42.10(pid=13128): Terminating (SIGTERM) 02:22:11.017399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Terminating (SIGTERM) 02:22:11.057838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Terminating (SIGTERM) 02:22:11.097883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13137): Terminating (SIGTERM) 02:22:11.138296 --- ParallelTerminationStrategy: PID 13125 died... 02:22:11.157341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13125): Terminated: ok {rc=0} 02:22:11.201546 --- ParallelTerminationStrategy: PID 13126 died... 02:22:11.219993 run iperf3-srv_10.42.42.10(pid=13126): Terminated {rc=256} 02:22:11.263752 --- ParallelTerminationStrategy: PID 13127 died... 02:22:11.282464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13127): Terminated: ok {rc=0} 02:22:11.326702 --- ParallelTerminationStrategy: PID 13128 died... 02:22:11.345274 run iperf3-srv_10.42.42.10(pid=13128): Terminated {rc=256} 02:22:11.389291 --- ParallelTerminationStrategy: PID 13131 died... 02:22:11.408048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Terminated: ok {rc=0} 02:22:11.452256 --- ParallelTerminationStrategy: PID 13134 died... 02:22:11.470958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Terminated: ok {rc=0} 02:22:11.515334 --- ParallelTerminationStrategy: PID 13137 died... 02:22:11.534261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13137): Terminated: ok {rc=0} 02:22:11.618216 bus /gobi_0: Setting Powered False 02:22:12.716120 bus /gobi_0: Setting Powered False 02:22:13.834603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:22:14.980844 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:14.992349 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:15.035013 tst iperf3.py: using LAC 25320 02:22:15.153476 tst iperf3.py: using RAC 75 02:22:15.278793 tst iperf3.py: using CellId 25320 02:22:15.403795 tst iperf3.py: using BVCI 25321 02:22:15.515731 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.526542 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.537376 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.549431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.560168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.570973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.581792 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.592426 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:15.603310 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:15.723629 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:15.962864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:16.301733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13139): Launched 02:22:16.589796 run iperf3-srv_10.42.42.10(pid=13140): Launched 02:22:16.718128 tst iperf3.py:8: start network... 02:22:16.925828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:17.399398 run create_hlr_db(pid=13141): Launched 02:22:17.514833 bus /gobi_6: Setting Powered False 02:22:18.575284 run create_hlr_db(pid=13141): Terminated: ok {rc=0} 02:22:19.013097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13143): Launched 02:22:19.333356 run osmo-hlr_10.42.42.2(pid=13144): Launched 02:22:19.456449 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:20.010723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13146): Launched 02:22:20.333170 run osmo-stp_10.42.42.5(pid=13147): Launched 02:22:20.461123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:21.017593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13149): Launched 02:22:21.141435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:21.412690 run patchelf(pid=13150): Launched 02:22:21.593185 run osmo-stp_10.42.42.5(pid=13147): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13147)] 02:22:21.729221 run osmo-stp_10.42.42.5(pid=13147): stdout: | (launched: 2022-12-10_02:22:20.274830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:21.866715 run osmo-stp_10.42.42.5(pid=13147): stderr: | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022220468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:22.003873 run osmo-stp_10.42.42.5(pid=13147): stdout: | (launched: 2022-12-10_02:22:20.274830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:22.136385 run osmo-stp_10.42.42.5(pid=13147): stderr: | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022220467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022220468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022220468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:22.292269 run patchelf(pid=13150): Terminating (SIGINT) 02:22:22.472876 run patchelf(pid=13150): Terminated: ok {rc=0} 02:22:22.603433 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13147): Process ended prematurely: osmo-stp_10.42.42.5(pid=13147) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13147)] [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 02:22:22.613566 tst iperf3.py:8: Test FAILED (7.7 sec) 02:22:22.641944 run osmo-hlr_10.42.42.2(pid=13144): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13144)] 02:22:22.692280 run osmo-hlr_10.42.42.2(pid=13144): stdout: | (launched: 2022-12-10_02:22:19.275383) 02:22:22.744331 run osmo-hlr_10.42.42.2(pid=13144): stderr: | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022219473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022219485 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022219493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022219493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022219493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:22.796568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13139): Terminating (SIGTERM) 02:22:22.838569 run iperf3-srv_10.42.42.10(pid=13140): Terminating (SIGTERM) 02:22:22.880408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13143): Terminating (SIGTERM) 02:22:22.922395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13146): Terminating (SIGTERM) 02:22:22.964188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13149): Terminating (SIGTERM) 02:22:23.006264 --- ParallelTerminationStrategy: PID 13139 died... 02:22:23.026318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13139): Terminated: ok {rc=0} 02:22:23.072476 --- ParallelTerminationStrategy: PID 13140 died... 02:22:23.092077 run iperf3-srv_10.42.42.10(pid=13140): Terminated {rc=256} 02:22:23.138090 --- ParallelTerminationStrategy: PID 13143 died... 02:22:23.157680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13143): Terminated: ok {rc=0} 02:22:23.203817 --- ParallelTerminationStrategy: PID 13146 died... 02:22:23.223431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13146): Terminated: ok {rc=0} 02:22:23.269755 --- ParallelTerminationStrategy: PID 13149 died... 02:22:23.290579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13149): Terminated: ok {rc=0} 02:22:23.378756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:22:24.525338 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:24.536746 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:24.572682 tst iperf3m4.py: using LAC 25321 02:22:24.691433 tst iperf3m4.py: using RAC 76 02:22:24.810635 tst iperf3m4.py: using CellId 25321 02:22:24.930322 tst iperf3m4.py: using BVCI 25322 02:22:25.039927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.050976 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.061819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.072903 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.084147 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.095286 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.106683 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.117755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:25.129032 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:25.253026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:25.368415 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:25.489247 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:25.604504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:25.820500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:26.143405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13151): Launched 02:22:26.422061 run iperf3-srv_10.42.42.10(pid=13152): Launched 02:22:26.543698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:22:26.760217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:27.082175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Launched 02:22:27.361613 run iperf3-srv_10.42.42.10(pid=13154): Launched 02:22:27.483212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:22:27.699846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:28.022341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Launched 02:22:28.301374 run iperf3-srv_10.42.42.10(pid=13156): Launched 02:22:28.422797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:22:28.639402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:28.961386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Launched 02:22:29.240559 run iperf3-srv_10.42.42.10(pid=13158): Launched 02:22:29.361556 tst iperf3m4.py:8: start network... 02:22:29.577203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:30.075226 run create_hlr_db(pid=13159): Launched 02:22:30.206120 bus /gobi_6: Setting Powered False 02:22:31.268885 run create_hlr_db(pid=13159): Terminated: ok {rc=0} 02:22:31.726371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13161): Launched 02:22:32.061808 run osmo-hlr_10.42.42.2(pid=13162): Launched 02:22:32.220266 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:32.753081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13164): Launched 02:22:33.054639 run osmo-stp_10.42.42.5(pid=13165): Launched 02:22:33.170267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:33.687438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13167): Launched 02:22:33.804921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:34.059362 run patchelf(pid=13168): Launched 02:22:34.227941 run osmo-stp_10.42.42.5(pid=13165): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13165)] 02:22:34.355567 run osmo-stp_10.42.42.5(pid=13165): stdout: | (launched: 2022-12-10_02:22:32.999775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:34.484737 run osmo-stp_10.42.42.5(pid=13165): stderr: | [0;m[38;5;43m20221210022233169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022233169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022233170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022233170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:34.614019 run osmo-stp_10.42.42.5(pid=13165): stdout: | (launched: 2022-12-10_02:22:32.999775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:34.738237 run osmo-stp_10.42.42.5(pid=13165): stderr: | [0;m[38;5;43m20221210022233169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022233169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022233170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022233170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022233171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:34.885350 run patchelf(pid=13168): Terminating (SIGINT) 02:22:35.054459 run patchelf(pid=13168): Terminated: ok {rc=0} 02:22:35.176538 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13165): Process ended prematurely: osmo-stp_10.42.42.5(pid=13165) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13165)] [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 02:22:35.186294 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:22:35.214679 run osmo-hlr_10.42.42.2(pid=13162): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13162)] 02:22:35.263245 run osmo-hlr_10.42.42.2(pid=13162): stdout: | (launched: 2022-12-10_02:22:31.998180) 02:22:35.313953 run osmo-hlr_10.42.42.2(pid=13162): stderr: | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022232213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022232228 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022232236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022232236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022232236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:35.364631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13151): Terminating (SIGTERM) 02:22:35.405202 run iperf3-srv_10.42.42.10(pid=13152): Terminating (SIGTERM) 02:22:35.445777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Terminating (SIGTERM) 02:22:35.486398 run iperf3-srv_10.42.42.10(pid=13154): Terminating (SIGTERM) 02:22:35.526880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Terminating (SIGTERM) 02:22:35.567339 run iperf3-srv_10.42.42.10(pid=13156): Terminating (SIGTERM) 02:22:35.607779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Terminating (SIGTERM) 02:22:35.648142 run iperf3-srv_10.42.42.10(pid=13158): Terminating (SIGTERM) 02:22:35.688487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13161): Terminating (SIGTERM) 02:22:35.729162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13164): Terminating (SIGTERM) 02:22:35.769820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13167): Terminating (SIGTERM) 02:22:35.810390 --- ParallelTerminationStrategy: PID 13151 died... 02:22:35.830389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13151): Terminated: ok {rc=0} 02:22:35.876393 --- ParallelTerminationStrategy: PID 13152 died... 02:22:35.895323 run iperf3-srv_10.42.42.10(pid=13152): Terminated {rc=256} 02:22:35.943700 --- ParallelTerminationStrategy: PID 13153 died... 02:22:35.962515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Terminated: ok {rc=0} 02:22:36.007094 --- ParallelTerminationStrategy: PID 13154 died... 02:22:36.025854 run iperf3-srv_10.42.42.10(pid=13154): Terminated {rc=256} 02:22:36.070197 --- ParallelTerminationStrategy: PID 13155 died... 02:22:36.089035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Terminated: ok {rc=0} 02:22:36.133960 --- ParallelTerminationStrategy: PID 13156 died... 02:22:36.152578 run iperf3-srv_10.42.42.10(pid=13156): Terminated {rc=256} 02:22:36.197575 --- ParallelTerminationStrategy: PID 13157 died... 02:22:36.216250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Terminated: ok {rc=0} 02:22:36.261094 --- ParallelTerminationStrategy: PID 13158 died... 02:22:36.279864 run iperf3-srv_10.42.42.10(pid=13158): Terminated {rc=256} 02:22:36.324150 --- ParallelTerminationStrategy: PID 13161 died... 02:22:36.343015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13161): Terminated: ok {rc=0} 02:22:36.387522 --- ParallelTerminationStrategy: PID 13164 died... 02:22:36.406317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13164): Terminated: ok {rc=0} 02:22:36.450734 --- ParallelTerminationStrategy: PID 13167 died... 02:22:36.469504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13167): Terminated: ok {rc=0} 02:22:36.556115 bus /gobi_4: Setting Powered False 02:22:37.656165 bus /gobi_4: Setting Powered False 02:22:38.771779 bus /gobi_1: Setting Powered False 02:22:39.871087 bus /gobi_1: Setting Powered False 02:22:40.983722 bus /gobi_0: Setting Powered False 02:22:42.081578 bus /gobi_0: Setting Powered False 02:22:43.197025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 02:22:44.299629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.311248 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:44.352059 tst ping.py: using LAC 25322 02:22:44.475579 tst ping.py: using RAC 77 02:22:44.599170 tst ping.py: using CellId 25322 02:22:44.722370 tst ping.py: using BVCI 25323 02:22:44.836931 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.848204 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.859275 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.870298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.881192 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.892019 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.903155 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.914172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:45.029613 tst ping.py:19: start network... 02:22:45.241221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:45.727214 run create_hlr_db(pid=13170): Launched 02:22:45.859391 bus /gobi_6: Setting Powered False 02:22:46.918535 run create_hlr_db(pid=13170): Terminated: ok {rc=0} 02:22:47.352636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13172): Launched 02:22:47.669591 run osmo-hlr_10.42.42.2(pid=13173): Launched 02:22:47.790097 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:48.333679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13175): Launched 02:22:48.649079 run osmo-stp_10.42.42.5(pid=13176): Launched 02:22:48.769703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:49.316195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13178): Launched 02:22:49.437318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:49.703249 run patchelf(pid=13179): Launched 02:22:49.879654 run osmo-stp_10.42.42.5(pid=13176): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13176)] 02:22:50.013477 run osmo-stp_10.42.42.5(pid=13176): stdout: | (launched: 2022-12-10_02:22:48.591737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:50.149046 run osmo-stp_10.42.42.5(pid=13176): stderr: | [0;m[38;5;43m20221210022248782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022248783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022248783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022248783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:50.285048 run osmo-stp_10.42.42.5(pid=13176): stdout: | (launched: 2022-12-10_02:22:48.591737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:50.414427 run osmo-stp_10.42.42.5(pid=13176): stderr: | [0;m[38;5;43m20221210022248782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022248783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022248783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022248783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022248784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:50.568660 run patchelf(pid=13179): Terminating (SIGINT) 02:22:50.746363 run patchelf(pid=13179): Terminated: ok {rc=0} 02:22:50.874692 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13176): Process ended prematurely: osmo-stp_10.42.42.5(pid=13176) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13176)] [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 02:22:50.884057 tst ping.py:22: Test FAILED (6.6 sec) 02:22:50.911833 run osmo-hlr_10.42.42.2(pid=13173): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13173)] 02:22:50.961439 run osmo-hlr_10.42.42.2(pid=13173): stdout: | (launched: 2022-12-10_02:22:47.612206) 02:22:51.012820 run osmo-hlr_10.42.42.2(pid=13173): stderr: | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022247807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022247819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022247828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022247828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022247828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:51.064431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13172): Terminating (SIGTERM) 02:22:51.105784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13175): Terminating (SIGTERM) 02:22:51.147193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13178): Terminating (SIGTERM) 02:22:51.188763 --- ParallelTerminationStrategy: PID 13172 died... 02:22:51.208669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13172): Terminated: ok {rc=0} 02:22:51.254680 --- ParallelTerminationStrategy: PID 13175 died... 02:22:51.274223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13175): Terminated: ok {rc=0} 02:22:51.319843 --- ParallelTerminationStrategy: PID 13178 died... 02:22:51.339183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13178): Terminated: ok {rc=0} 02:22:51.426130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:22:52.513297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:52.525257 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:52.570506 tst ping_idle_ping.py: using LAC 25323 02:22:52.695435 tst ping_idle_ping.py: using RAC 78 02:22:52.816505 tst ping_idle_ping.py: using CellId 25323 02:22:52.939237 tst ping_idle_ping.py: using BVCI 25324 02:22:53.055633 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.066963 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.078255 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.089379 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.100269 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.111243 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.122319 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:53.133472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:53.251545 tst ping_idle_ping.py:24: start network... 02:22:53.464696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:53.957065 run create_hlr_db(pid=13180): Launched 02:22:54.086610 bus /gobi_6: Setting Powered False 02:22:55.149109 run create_hlr_db(pid=13180): Terminated: ok {rc=0} 02:22:55.572656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Launched 02:22:55.870784 run osmo-hlr_10.42.42.2(pid=13183): Launched 02:22:55.983941 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:56.499417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Launched 02:22:56.797411 run osmo-stp_10.42.42.5(pid=13186): Launched 02:22:56.912268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:57.426218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13188): Launched 02:22:57.540263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:57.790246 run patchelf(pid=13189): Launched 02:22:57.956139 run osmo-stp_10.42.42.5(pid=13186): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] 02:22:58.082394 run osmo-stp_10.42.42.5(pid=13186): stdout: | (launched: 2022-12-10_02:22:56.742529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:58.210222 run osmo-stp_10.42.42.5(pid=13186): stderr: | [0;m[38;5;43m20221210022256912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022256912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022256913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022256913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:58.338112 run osmo-stp_10.42.42.5(pid=13186): stdout: | (launched: 2022-12-10_02:22:56.742529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:58.459992 run osmo-stp_10.42.42.5(pid=13186): stderr: | [0;m[38;5;43m20221210022256912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022256912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022256913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022256913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022256915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:58.604299 run patchelf(pid=13189): Terminating (SIGINT) 02:22:58.771248 run patchelf(pid=13189): Terminated: ok {rc=0} 02:22:58.892311 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13186): Process ended prematurely: osmo-stp_10.42.42.5(pid=13186) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 02:22:58.901266 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:22:58.928425 run osmo-hlr_10.42.42.2(pid=13183): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13183)] 02:22:58.976506 run osmo-hlr_10.42.42.2(pid=13183): stdout: | (launched: 2022-12-10_02:22:55.816487) 02:22:59.026725 run osmo-hlr_10.42.42.2(pid=13183): stderr: | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022255990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022256002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022256010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022256011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022256011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:59.077277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Terminating (SIGTERM) 02:22:59.117622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Terminating (SIGTERM) 02:22:59.157902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13188): Terminating (SIGTERM) 02:22:59.198560 --- ParallelTerminationStrategy: PID 13182 died... 02:22:59.217935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Terminated: ok {rc=0} 02:22:59.262708 --- ParallelTerminationStrategy: PID 13185 died... 02:22:59.281562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Terminated: ok {rc=0} 02:22:59.326408 --- ParallelTerminationStrategy: PID 13188 died... 02:22:59.345126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13188): Terminated: ok {rc=0} 02:22:59.429332 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:23:00.726370 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:23:00.732650 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:23:00.753352 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:23:00.791951 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:23:00.896258 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:23:00.923016 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:23:00.962278 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:23:01.580116 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:23:01.639274 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:01.652421 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:01.710661 tst cs_paging_gprs_active.py: using LAC 25324 02:23:01.879555 tst cs_paging_gprs_active.py: using RAC 79 02:23:01.999911 tst cs_paging_gprs_active.py: using CellId 25324 02:23:02.122799 tst cs_paging_gprs_active.py: using BVCI 25325 02:23:02.237101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.248323 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.259398 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.271186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.282975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.294940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.306924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.318690 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:02.330481 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:02.449152 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:02.567898 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:23:02.786609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:03.111030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13194): Launched 02:23:03.392925 run iperf3-srv_10.42.42.10(pid=13195): Launched 02:23:03.515757 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:23:03.734037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:04.058971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13196): Launched 02:23:04.340701 run iperf3-srv_10.42.42.10(pid=13197): Launched 02:23:04.463327 tst cs_paging_gprs_active.py:38: start network... 02:23:04.682311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:05.185110 run create_hlr_db(pid=13198): Launched 02:23:05.318205 bus /gobi_6: Setting Powered False 02:23:06.382844 run create_hlr_db(pid=13198): Terminated: ok {rc=0} 02:23:06.832115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13200): Launched 02:23:07.155943 run osmo-hlr_10.42.42.2(pid=13201): Launched 02:23:07.279984 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:07.835313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13203): Launched 02:23:08.158962 run osmo-stp_10.42.42.5(pid=13204): Launched 02:23:08.282994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:08.842137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13206): Launched 02:23:08.967351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:09.240377 run patchelf(pid=13207): Launched 02:23:09.421263 run osmo-stp_10.42.42.5(pid=13204): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13204)] 02:23:09.559207 run osmo-stp_10.42.42.5(pid=13204): stdout: | (launched: 2022-12-10_02:23:08.100177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:09.697860 run osmo-stp_10.42.42.5(pid=13204): stderr: | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022308292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:09.836198 run osmo-stp_10.42.42.5(pid=13204): stdout: | (launched: 2022-12-10_02:23:08.100177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:09.969050 run osmo-stp_10.42.42.5(pid=13204): stderr: | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022308292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022308292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022308295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:10.126466 run patchelf(pid=13207): Terminating (SIGINT) 02:23:10.307921 run patchelf(pid=13207): Terminated: ok {rc=0} 02:23:10.439247 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13204): Process ended prematurely: osmo-stp_10.42.42.5(pid=13204) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13204)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:23:10.449142 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:23:10.477773 run osmo-hlr_10.42.42.2(pid=13201): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13201)] 02:23:10.528209 run osmo-hlr_10.42.42.2(pid=13201): stdout: | (launched: 2022-12-10_02:23:07.097210) 02:23:10.580252 run osmo-hlr_10.42.42.2(pid=13201): stderr: | [0;m[1;31m20221210022307297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022307297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022307298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022307298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022307298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022307298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022307311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022307321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022307321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022307321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:10.632668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13194): Terminating (SIGTERM) 02:23:10.674528 run iperf3-srv_10.42.42.10(pid=13195): Terminating (SIGTERM) 02:23:10.716297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13196): Terminating (SIGTERM) 02:23:10.758316 run iperf3-srv_10.42.42.10(pid=13197): Terminating (SIGTERM) 02:23:10.799860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13200): Terminating (SIGTERM) 02:23:10.841999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13203): Terminating (SIGTERM) 02:23:10.883652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13206): Terminating (SIGTERM) 02:23:10.925618 --- ParallelTerminationStrategy: PID 13194 died... 02:23:10.945557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13194): Terminated: ok {rc=0} 02:23:10.992271 --- ParallelTerminationStrategy: PID 13195 died... 02:23:11.011819 run iperf3-srv_10.42.42.10(pid=13195): Terminated {rc=256} 02:23:11.057665 --- ParallelTerminationStrategy: PID 13196 died... 02:23:11.077063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13196): Terminated: ok {rc=0} 02:23:11.122931 --- ParallelTerminationStrategy: PID 13197 died... 02:23:11.142345 run iperf3-srv_10.42.42.10(pid=13197): Terminated {rc=256} 02:23:11.189021 --- ParallelTerminationStrategy: PID 13200 died... 02:23:11.208576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13200): Terminated: ok {rc=0} 02:23:11.254601 --- ParallelTerminationStrategy: PID 13203 died... 02:23:11.274136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13203): Terminated: ok {rc=0} 02:23:11.319992 --- ParallelTerminationStrategy: PID 13206 died... 02:23:11.339526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13206): Terminated: ok {rc=0} 02:23:11.426349 bus /gobi_0: Setting Powered False 02:23:12.524798 bus /gobi_0: Setting Powered False 02:23:13.640084 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:23:14.787251 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:14.798689 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:14.857304 tst iperf3.py: using LAC 25325 02:23:14.975099 tst iperf3.py: using RAC 80 02:23:15.096378 tst iperf3.py: using CellId 25325 02:23:15.217045 tst iperf3.py: using BVCI 25326 02:23:15.328249 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.339068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.349734 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.360432 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.371149 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.382022 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.392864 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.403761 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:15.414707 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:15.535406 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:23:15.753767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:16.111160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Launched 02:23:16.531400 run iperf3-srv_10.42.42.10(pid=13242): Launched 02:23:16.759551 tst iperf3.py:8: start network... 02:23:17.040510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:17.637380 run create_hlr_db(pid=13283): Launched 02:23:17.813851 bus /gobi_6: Setting Powered False 02:23:18.904121 run create_hlr_db(pid=13283): Terminated: ok {rc=0} 02:23:19.410484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Launched 02:23:19.750205 run osmo-hlr_10.42.42.2(pid=13483): Launched 02:23:20.002938 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:20.671030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Launched 02:23:21.013441 run osmo-stp_10.42.42.5(pid=13486): Launched 02:23:21.260478 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:21.909717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13490): Launched 02:23:22.048016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:22.328199 run patchelf(pid=13491): Launched 02:23:22.524563 run osmo-stp_10.42.42.5(pid=13486): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] 02:23:22.663717 run osmo-stp_10.42.42.5(pid=13486): stdout: | (launched: 2022-12-10_02:23:20.950669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:22.805789 run osmo-stp_10.42.42.5(pid=13486): stderr: | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022321252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:22.946369 run osmo-stp_10.42.42.5(pid=13486): stdout: | (launched: 2022-12-10_02:23:20.950669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:23.081589 run osmo-stp_10.42.42.5(pid=13486): stderr: | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022321251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022321252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022321254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:23.241989 run patchelf(pid=13491): Terminating (SIGINT) 02:23:23.425653 run patchelf(pid=13491): Terminated: ok {rc=0} 02:23:23.559313 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13486): Process ended prematurely: osmo-stp_10.42.42.5(pid=13486) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 02:23:23.570519 tst iperf3.py:8: Test FAILED (8.8 sec) 02:23:23.600397 run osmo-hlr_10.42.42.2(pid=13483): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13483)] 02:23:23.652622 run osmo-hlr_10.42.42.2(pid=13483): stdout: | (launched: 2022-12-10_02:23:19.686250) 02:23:23.706304 run osmo-hlr_10.42.42.2(pid=13483): stderr: | [0;m[1;31m20221210022319992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022319992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022319992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022319992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022319992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022319993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022320011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022320024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022320024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022320024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:23.760664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Terminating (SIGTERM) 02:23:23.804725 run iperf3-srv_10.42.42.10(pid=13242): Terminating (SIGTERM) 02:23:23.851150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Terminating (SIGTERM) 02:23:23.895562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Terminating (SIGTERM) 02:23:23.941543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13490): Terminating (SIGTERM) 02:23:23.987612 --- ParallelTerminationStrategy: PID 13208 died... 02:23:24.008883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Terminated: ok {rc=0} 02:23:24.060170 --- ParallelTerminationStrategy: PID 13242 died... 02:23:24.081086 run iperf3-srv_10.42.42.10(pid=13242): Terminated {rc=256} 02:23:24.129380 --- ParallelTerminationStrategy: PID 13482 died... 02:23:24.150247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Terminated: ok {rc=0} 02:23:24.198444 --- ParallelTerminationStrategy: PID 13485 died... 02:23:24.219510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Terminated: ok {rc=0} 02:23:24.268239 --- ParallelTerminationStrategy: PID 13490 died... 02:23:24.289384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13490): Terminated: ok {rc=0} 02:23:24.381953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:23:25.539066 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:25.552032 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:25.615700 tst iperf3m4.py: using LAC 25326 02:23:25.748078 tst iperf3m4.py: using RAC 81 02:23:25.876434 tst iperf3m4.py: using CellId 25326 02:23:26.010817 tst iperf3m4.py: using BVCI 25327 02:23:26.133411 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.145843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.158053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.170183 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.181926 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.194933 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.207503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.219473 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:26.232130 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:26.357466 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:26.485835 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:26.611173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:26.737623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:23:26.963599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:27.299213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Launched 02:23:27.604277 run iperf3-srv_10.42.42.10(pid=13493): Launched 02:23:27.745687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:23:27.971399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:28.310574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Launched 02:23:28.616836 run iperf3-srv_10.42.42.10(pid=13495): Launched 02:23:28.757604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:23:28.983062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:29.323772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Launched 02:23:29.629911 run iperf3-srv_10.42.42.10(pid=13497): Launched 02:23:29.770918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:23:29.998326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:30.338473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13498): Launched 02:23:30.643500 run iperf3-srv_10.42.42.10(pid=13499): Launched 02:23:30.785042 tst iperf3m4.py:8: start network... 02:23:31.035679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:31.621791 run create_hlr_db(pid=13500): Launched 02:23:31.851044 bus /gobi_6: Setting Powered False 02:23:32.953493 run create_hlr_db(pid=13500): Terminated: ok {rc=0} 02:23:33.449458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13502): Launched 02:23:33.802237 run osmo-hlr_10.42.42.2(pid=13503): Launched 02:23:34.057999 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:34.739558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13505): Launched 02:23:35.095229 run osmo-stp_10.42.42.5(pid=13506): Launched 02:23:35.351272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:36.014606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13508): Launched 02:23:36.154548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:36.441240 run patchelf(pid=13509): Launched 02:23:36.642884 run osmo-stp_10.42.42.5(pid=13506): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13506)] 02:23:36.785174 run osmo-stp_10.42.42.5(pid=13506): stdout: | (launched: 2022-12-10_02:23:35.026790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:36.929239 run osmo-stp_10.42.42.5(pid=13506): stderr: | [0;m[38;5;43m20221210022335331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022335332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022335332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022335332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:37.072702 run osmo-stp_10.42.42.5(pid=13506): stdout: | (launched: 2022-12-10_02:23:35.026790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:37.210434 run osmo-stp_10.42.42.5(pid=13506): stderr: | [0;m[38;5;43m20221210022335331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022335332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022335332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022335332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022335333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:37.375016 run patchelf(pid=13509): Terminating (SIGINT) 02:23:37.563463 run patchelf(pid=13509): Terminated: ok {rc=0} 02:23:37.701412 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13506): Process ended prematurely: osmo-stp_10.42.42.5(pid=13506) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13506)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:23:37.712428 tst iperf3m4.py:8: Test FAILED (12.2 sec) 02:23:37.743552 run osmo-hlr_10.42.42.2(pid=13503): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13503)] 02:23:37.796428 run osmo-hlr_10.42.42.2(pid=13503): stdout: | (launched: 2022-12-10_02:23:33.736576) 02:23:37.850816 run osmo-hlr_10.42.42.2(pid=13503): stderr: | [0;m[1;31m20221210022334054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022334054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022334054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022334055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022334055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022334055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022334075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022334083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022334084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022334084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:37.906994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Terminating (SIGTERM) 02:23:37.951991 run iperf3-srv_10.42.42.10(pid=13493): Terminating (SIGTERM) 02:23:37.999148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminating (SIGTERM) 02:23:38.043925 run iperf3-srv_10.42.42.10(pid=13495): Terminating (SIGTERM) 02:23:38.091896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Terminating (SIGTERM) 02:23:38.137510 run iperf3-srv_10.42.42.10(pid=13497): Terminating (SIGTERM) 02:23:38.184408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13498): Terminating (SIGTERM) 02:23:38.229251 run iperf3-srv_10.42.42.10(pid=13499): Terminating (SIGTERM) 02:23:38.278124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13502): Terminating (SIGTERM) 02:23:38.322961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13505): Terminating (SIGTERM) 02:23:38.369921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13508): Terminating (SIGTERM) 02:23:38.415958 --- ParallelTerminationStrategy: PID 13492 died... 02:23:38.437394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Terminated: ok {rc=0} 02:23:38.488470 --- ParallelTerminationStrategy: PID 13493 died... 02:23:38.509673 run iperf3-srv_10.42.42.10(pid=13493): Terminated {rc=256} 02:23:38.559045 --- ParallelTerminationStrategy: PID 13494 died... 02:23:38.580021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminated: ok {rc=0} 02:23:38.629700 --- ParallelTerminationStrategy: PID 13495 died... 02:23:38.651070 run iperf3-srv_10.42.42.10(pid=13495): Terminated {rc=256} 02:23:38.700582 --- ParallelTerminationStrategy: PID 13496 died... 02:23:38.721519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Terminated: ok {rc=0} 02:23:38.769715 --- ParallelTerminationStrategy: PID 13497 died... 02:23:38.790646 run iperf3-srv_10.42.42.10(pid=13497): Terminated {rc=256} 02:23:38.838864 --- ParallelTerminationStrategy: PID 13498 died... 02:23:38.861980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13498): Terminated: ok {rc=0} 02:23:38.910675 --- ParallelTerminationStrategy: PID 13499 died... 02:23:38.931887 run iperf3-srv_10.42.42.10(pid=13499): Terminated {rc=256} 02:23:38.980164 --- ParallelTerminationStrategy: PID 13502 died... 02:23:39.001431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13502): Terminated: ok {rc=0} 02:23:39.049413 --- ParallelTerminationStrategy: PID 13505 died... 02:23:39.073915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13505): Terminated: ok {rc=0} 02:23:39.122684 --- ParallelTerminationStrategy: PID 13508 died... 02:23:39.143263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13508): Terminated: ok {rc=0} 02:23:39.234943 bus /gobi_4: Setting Powered False 02:23:40.335813 bus /gobi_4: Setting Powered False 02:23:41.450761 bus /gobi_1: Setting Powered False 02:23:42.547957 bus /gobi_1: Setting Powered False 02:23:43.666783 bus /gobi_0: Setting Powered False 02:23:44.764745 bus /gobi_0: Setting Powered False 02:23:45.881729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:23:47.006514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.023257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:47.095565 tst ping.py: using LAC 25327 02:23:47.228064 tst ping.py: using RAC 82 02:23:47.360031 tst ping.py: using CellId 25327 02:23:47.483790 tst ping.py: using BVCI 25328 02:23:47.599478 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.610974 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.622223 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.633671 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.645059 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.656178 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.667627 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.678834 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:47.797329 tst ping.py:19: start network... 02:23:48.010107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:48.499580 run create_hlr_db(pid=13510): Launched 02:23:48.628921 bus /gobi_6: Setting Powered False 02:23:49.691962 run create_hlr_db(pid=13510): Terminated: ok {rc=0} 02:23:50.116011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13512): Launched 02:23:50.412226 run osmo-hlr_10.42.42.2(pid=13513): Launched 02:23:50.525744 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:51.037139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13515): Launched 02:23:51.333531 run osmo-stp_10.42.42.5(pid=13516): Launched 02:23:51.447382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:51.961010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13518): Launched 02:23:52.075426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:52.325064 run patchelf(pid=13519): Launched 02:23:52.491541 run osmo-stp_10.42.42.5(pid=13516): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13516)] 02:23:52.617617 run osmo-stp_10.42.42.5(pid=13516): stdout: | (launched: 2022-12-10_02:23:51.278753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:52.745327 run osmo-stp_10.42.42.5(pid=13516): stderr: | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022351448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:52.872851 run osmo-stp_10.42.42.5(pid=13516): stdout: | (launched: 2022-12-10_02:23:51.278753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:52.994670 run osmo-stp_10.42.42.5(pid=13516): stderr: | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022351448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022351448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022351449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:53.138833 run patchelf(pid=13519): Terminating (SIGINT) 02:23:53.306528 run patchelf(pid=13519): Terminated: ok {rc=0} 02:23:53.426944 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13516): Process ended prematurely: osmo-stp_10.42.42.5(pid=13516) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13516)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 02:23:53.435833 tst ping.py:22: Test FAILED (6.4 sec) 02:23:53.462781 run osmo-hlr_10.42.42.2(pid=13513): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13513)] 02:23:53.510669 run osmo-hlr_10.42.42.2(pid=13513): stdout: | (launched: 2022-12-10_02:23:50.358078) 02:23:53.560493 run osmo-hlr_10.42.42.2(pid=13513): stderr: | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022350532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022350550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022350559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022350559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022350559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:53.610729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13512): Terminating (SIGTERM) 02:23:53.650917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13515): Terminating (SIGTERM) 02:23:53.691145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13518): Terminating (SIGTERM) 02:23:53.731521 --- ParallelTerminationStrategy: PID 13512 died... 02:23:53.750719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13512): Terminated: ok {rc=0} 02:23:53.795815 --- ParallelTerminationStrategy: PID 13515 died... 02:23:53.814677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13515): Terminated: ok {rc=0} 02:23:53.859029 --- ParallelTerminationStrategy: PID 13518 died... 02:23:53.877743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13518): Terminated: ok {rc=0} 02:23:53.961906 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:23:55.049396 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.061884 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:55.121841 tst ping_idle_ping.py: using LAC 25328 02:23:55.250271 tst ping_idle_ping.py: using RAC 83 02:23:55.377087 tst ping_idle_ping.py: using CellId 25328 02:23:55.501337 tst ping_idle_ping.py: using BVCI 25329 02:23:55.617780 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.629203 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.640186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.653626 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.664475 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.675367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.686737 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:55.697814 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:55.811254 tst ping_idle_ping.py:24: start network... 02:23:56.009470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:56.469772 run create_hlr_db(pid=13520): Launched 02:23:56.584145 bus /gobi_6: Setting Powered False 02:23:57.643819 run create_hlr_db(pid=13520): Terminated: ok {rc=0} 02:23:58.077349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13522): Launched 02:23:58.394952 run osmo-hlr_10.42.42.2(pid=13523): Launched 02:23:58.516292 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:59.063827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13525): Launched 02:23:59.381500 run osmo-stp_10.42.42.5(pid=13526): Launched 02:23:59.502752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:00.052193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13528): Launched 02:24:00.174559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:00.442393 run patchelf(pid=13529): Launched 02:24:00.621888 run osmo-stp_10.42.42.5(pid=13526): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13526)] 02:24:00.756788 run osmo-stp_10.42.42.5(pid=13526): stdout: | (launched: 2022-12-10_02:23:59.323543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:00.895191 run osmo-stp_10.42.42.5(pid=13526): stderr: | [0;m[38;5;43m20221210022359516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022359517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022359517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022359517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:01.043381 run osmo-stp_10.42.42.5(pid=13526): stdout: | (launched: 2022-12-10_02:23:59.323543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:01.172679 run osmo-stp_10.42.42.5(pid=13526): stderr: | [0;m[38;5;43m20221210022359516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022359517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022359517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022359517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022359518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:01.324132 run patchelf(pid=13529): Terminating (SIGINT) 02:24:01.499146 run patchelf(pid=13529): Terminated: ok {rc=0} 02:24:01.624546 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13526): Process ended prematurely: osmo-stp_10.42.42.5(pid=13526) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13526)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:24:01.634576 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:24:01.667108 run osmo-hlr_10.42.42.2(pid=13523): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13523)] 02:24:01.718546 run osmo-hlr_10.42.42.2(pid=13523): stdout: | (launched: 2022-12-10_02:23:58.337299) 02:24:01.770885 run osmo-hlr_10.42.42.2(pid=13523): stderr: | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022358534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022358546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022358555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022358555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022358555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:01.824257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13522): Terminating (SIGTERM) 02:24:01.868031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13525): Terminating (SIGTERM) 02:24:01.912347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13528): Terminating (SIGTERM) 02:24:01.957931 --- ParallelTerminationStrategy: PID 13522 died... 02:24:01.978166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13522): Terminated: ok {rc=0} 02:24:02.027881 --- ParallelTerminationStrategy: PID 13525 died... 02:24:02.047807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13525): Terminated: ok {rc=0} 02:24:02.096708 --- ParallelTerminationStrategy: PID 13528 died... 02:24:02.116586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13528): Terminated: ok {rc=0} 02:24:02.206041 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:24:03.508021 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:24:03.515398 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:24:03.537183 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:24:03.576682 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:24:03.664734 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:24:03.685908 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:24:03.725153 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:24:04.320156 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:24:04.372420 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:04.383847 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:04.442179 tst cs_paging_gprs_active.py: using LAC 25329 02:24:04.568790 tst cs_paging_gprs_active.py: using RAC 84 02:24:04.695588 tst cs_paging_gprs_active.py: using CellId 25329 02:24:04.827424 tst cs_paging_gprs_active.py: using BVCI 25330 02:24:04.946554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:04.957870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:04.968770 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:04.979960 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:04.991046 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:05.002206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:05.013534 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:05.024789 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:05.036249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:05.153857 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:05.274059 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:24:05.493434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:05.817207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Launched 02:24:06.097721 run iperf3-srv_10.42.42.10(pid=13535): Launched 02:24:06.219563 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:24:06.436906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:06.761729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13536): Launched 02:24:07.042087 run iperf3-srv_10.42.42.10(pid=13537): Launched 02:24:07.163838 tst cs_paging_gprs_active.py:38: start network... 02:24:07.381115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:07.882766 run create_hlr_db(pid=13538): Launched 02:24:08.014715 bus /gobi_6: Setting Powered False 02:24:09.078463 run create_hlr_db(pid=13538): Terminated: ok {rc=0} 02:24:09.528256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13540): Launched 02:24:09.852267 run osmo-hlr_10.42.42.2(pid=13541): Launched 02:24:09.976487 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:10.531447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13543): Launched 02:24:10.855649 run osmo-stp_10.42.42.5(pid=13544): Launched 02:24:10.979235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:11.536636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13546): Launched 02:24:11.661109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:11.933162 run patchelf(pid=13547): Launched 02:24:12.125197 run osmo-stp_10.42.42.5(pid=13544): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13544)] 02:24:12.262413 run osmo-stp_10.42.42.5(pid=13544): stdout: | (launched: 2022-12-10_02:24:10.796430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:12.401219 run osmo-stp_10.42.42.5(pid=13544): stderr: | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022410991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:12.540027 run osmo-stp_10.42.42.5(pid=13544): stdout: | (launched: 2022-12-10_02:24:10.796430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:12.673346 run osmo-stp_10.42.42.5(pid=13544): stderr: | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022410990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022410991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022410991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:12.830627 run patchelf(pid=13547): Terminating (SIGINT) 02:24:13.011967 run patchelf(pid=13547): Terminated: ok {rc=0} 02:24:13.143055 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13544): Process ended prematurely: osmo-stp_10.42.42.5(pid=13544) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13544)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:24:13.152929 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:24:13.181314 run osmo-hlr_10.42.42.2(pid=13541): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13541)] 02:24:13.231274 run osmo-hlr_10.42.42.2(pid=13541): stdout: | (launched: 2022-12-10_02:24:09.793536) 02:24:13.283168 run osmo-hlr_10.42.42.2(pid=13541): stderr: | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022409994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022410006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022410014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022410015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022410015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:13.335434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Terminating (SIGTERM) 02:24:13.377529 run iperf3-srv_10.42.42.10(pid=13535): Terminating (SIGTERM) 02:24:13.419475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13536): Terminating (SIGTERM) 02:24:13.461825 run iperf3-srv_10.42.42.10(pid=13537): Terminating (SIGTERM) 02:24:13.504081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13540): Terminating (SIGTERM) 02:24:13.546453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13543): Terminating (SIGTERM) 02:24:13.588411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13546): Terminating (SIGTERM) 02:24:13.630379 --- ParallelTerminationStrategy: PID 13534 died... 02:24:13.650282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Terminated: ok {rc=0} 02:24:13.696376 --- ParallelTerminationStrategy: PID 13535 died... 02:24:13.715874 run iperf3-srv_10.42.42.10(pid=13535): Terminated {rc=256} 02:24:13.761732 --- ParallelTerminationStrategy: PID 13536 died... 02:24:13.781195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13536): Terminated: ok {rc=0} 02:24:13.827377 --- ParallelTerminationStrategy: PID 13537 died... 02:24:13.846778 run iperf3-srv_10.42.42.10(pid=13537): Terminated {rc=256} 02:24:13.892594 --- ParallelTerminationStrategy: PID 13540 died... 02:24:13.912137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13540): Terminated: ok {rc=0} 02:24:13.957908 --- ParallelTerminationStrategy: PID 13543 died... 02:24:13.977340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13543): Terminated: ok {rc=0} 02:24:14.023238 --- ParallelTerminationStrategy: PID 13546 died... 02:24:14.042766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13546): Terminated: ok {rc=0} 02:24:14.130874 bus /gobi_0: Setting Powered False 02:24:15.229954 bus /gobi_0: Setting Powered False 02:24:16.345098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:24:17.495905 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:17.508081 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:17.570276 tst iperf3.py: using LAC 25330 02:24:17.697428 tst iperf3.py: using RAC 85 02:24:17.824203 tst iperf3.py: using CellId 25330 02:24:17.950838 tst iperf3.py: using BVCI 25331 02:24:18.068420 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.079767 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.090800 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.102090 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.113288 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.124278 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.135685 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.146739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:18.158095 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:18.274526 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:18.492296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:18.816570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13548): Launched 02:24:19.097226 run iperf3-srv_10.42.42.10(pid=13549): Launched 02:24:19.218804 tst iperf3.py:8: start network... 02:24:19.435461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:19.936098 run create_hlr_db(pid=13550): Launched 02:24:20.068330 bus /gobi_6: Setting Powered False 02:24:21.132603 run create_hlr_db(pid=13550): Terminated: ok {rc=0} 02:24:21.564317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Launched 02:24:21.867020 run osmo-hlr_10.42.42.2(pid=13553): Launched 02:24:21.983723 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:22.507699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Launched 02:24:22.810314 run osmo-stp_10.42.42.5(pid=13556): Launched 02:24:22.926640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:23.447681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Launched 02:24:23.565302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:23.820529 run patchelf(pid=13559): Launched 02:24:23.989460 run osmo-stp_10.42.42.5(pid=13556): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] 02:24:24.117689 run osmo-stp_10.42.42.5(pid=13556): stdout: | (launched: 2022-12-10_02:24:22.755368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:24.247025 run osmo-stp_10.42.42.5(pid=13556): stderr: | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022422925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:24.376789 run osmo-stp_10.42.42.5(pid=13556): stdout: | (launched: 2022-12-10_02:24:22.755368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:24.501174 run osmo-stp_10.42.42.5(pid=13556): stderr: | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022422924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022422925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022422925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:24.648244 run patchelf(pid=13559): Terminating (SIGINT) 02:24:24.818575 run patchelf(pid=13559): Terminated: ok {rc=0} 02:24:24.941076 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13556): Process ended prematurely: osmo-stp_10.42.42.5(pid=13556) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 02:24:24.950496 tst iperf3.py:8: Test FAILED (7.5 sec) 02:24:24.977979 run osmo-hlr_10.42.42.2(pid=13553): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13553)] 02:24:25.025552 run osmo-hlr_10.42.42.2(pid=13553): stdout: | (launched: 2022-12-10_02:24:21.811895) 02:24:25.074976 run osmo-hlr_10.42.42.2(pid=13553): stderr: | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022421988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022422000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022422009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022422010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022422010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:25.125195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13548): Terminating (SIGTERM) 02:24:25.165179 run iperf3-srv_10.42.42.10(pid=13549): Terminating (SIGTERM) 02:24:25.205168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Terminating (SIGTERM) 02:24:25.245277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Terminating (SIGTERM) 02:24:25.285307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Terminating (SIGTERM) 02:24:25.325917 --- ParallelTerminationStrategy: PID 13548 died... 02:24:25.345028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13548): Terminated: ok {rc=0} 02:24:25.389826 --- ParallelTerminationStrategy: PID 13549 died... 02:24:25.408759 run iperf3-srv_10.42.42.10(pid=13549): Terminated {rc=256} 02:24:25.453290 --- ParallelTerminationStrategy: PID 13552 died... 02:24:25.471851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Terminated: ok {rc=0} 02:24:25.515942 --- ParallelTerminationStrategy: PID 13555 died... 02:24:25.534999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Terminated: ok {rc=0} 02:24:25.579945 --- ParallelTerminationStrategy: PID 13558 died... 02:24:25.598800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Terminated: ok {rc=0} 02:24:25.683982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:24:26.834032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:26.846038 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:26.905945 tst iperf3m4.py: using LAC 25331 02:24:27.034513 tst iperf3m4.py: using RAC 86 02:24:27.162307 tst iperf3m4.py: using CellId 25331 02:24:27.289152 tst iperf3m4.py: using BVCI 25332 02:24:27.406823 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.418446 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.429715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.441249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.452571 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.463811 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.475268 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.486664 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:27.498335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:27.615274 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:27.737600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:27.854340 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:27.974402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:28.193653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:28.518712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13560): Launched 02:24:28.800039 run iperf3-srv_10.42.42.10(pid=13561): Launched 02:24:28.921685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:24:29.138897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:29.463378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Launched 02:24:29.745037 run iperf3-srv_10.42.42.10(pid=13563): Launched 02:24:29.866639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:24:30.083493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:30.406831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Launched 02:24:30.688559 run iperf3-srv_10.42.42.10(pid=13565): Launched 02:24:30.810171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:24:31.039486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:31.376429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Launched 02:24:31.680401 run iperf3-srv_10.42.42.10(pid=13567): Launched 02:24:31.818562 tst iperf3m4.py:8: start network... 02:24:32.039799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:32.545414 run create_hlr_db(pid=13568): Launched 02:24:32.677188 bus /gobi_6: Setting Powered False 02:24:33.740511 run create_hlr_db(pid=13568): Terminated: ok {rc=0} 02:24:34.171755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13570): Launched 02:24:34.474677 run osmo-hlr_10.42.42.2(pid=13571): Launched 02:24:34.591987 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:35.130924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13573): Launched 02:24:35.433336 run osmo-stp_10.42.42.5(pid=13574): Launched 02:24:35.550005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:36.072917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13576): Launched 02:24:36.189537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:36.444422 run patchelf(pid=13577): Launched 02:24:36.614320 run osmo-stp_10.42.42.5(pid=13574): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13574)] 02:24:36.742654 run osmo-stp_10.42.42.5(pid=13574): stdout: | (launched: 2022-12-10_02:24:35.378059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:36.872233 run osmo-stp_10.42.42.5(pid=13574): stderr: | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022435550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:37.001881 run osmo-stp_10.42.42.5(pid=13574): stdout: | (launched: 2022-12-10_02:24:35.378059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:37.126418 run osmo-stp_10.42.42.5(pid=13574): stderr: | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022435549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022435550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022435550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:37.274170 run patchelf(pid=13577): Terminating (SIGINT) 02:24:37.444119 run patchelf(pid=13577): Terminated: ok {rc=0} 02:24:37.567087 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13574): Process ended prematurely: osmo-stp_10.42.42.5(pid=13574) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13574)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:24:37.576650 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:24:37.604611 run osmo-hlr_10.42.42.2(pid=13571): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13571)] 02:24:37.654168 run osmo-hlr_10.42.42.2(pid=13571): stdout: | (launched: 2022-12-10_02:24:34.419685) 02:24:37.705106 run osmo-hlr_10.42.42.2(pid=13571): stderr: | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022434595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022434607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022434617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022434618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022434618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:37.755939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13560): Terminating (SIGTERM) 02:24:37.796358 run iperf3-srv_10.42.42.10(pid=13561): Terminating (SIGTERM) 02:24:37.836857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Terminating (SIGTERM) 02:24:37.877636 run iperf3-srv_10.42.42.10(pid=13563): Terminating (SIGTERM) 02:24:37.918131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminating (SIGTERM) 02:24:37.958728 run iperf3-srv_10.42.42.10(pid=13565): Terminating (SIGTERM) 02:24:37.999161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Terminating (SIGTERM) 02:24:38.039566 run iperf3-srv_10.42.42.10(pid=13567): Terminating (SIGTERM) 02:24:38.079974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13570): Terminating (SIGTERM) 02:24:38.120569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13573): Terminating (SIGTERM) 02:24:38.161040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13576): Terminating (SIGTERM) 02:24:38.201547 --- ParallelTerminationStrategy: PID 13560 died... 02:24:38.220706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13560): Terminated: ok {rc=0} 02:24:38.265942 --- ParallelTerminationStrategy: PID 13561 died... 02:24:38.284618 run iperf3-srv_10.42.42.10(pid=13561): Terminated {rc=256} 02:24:38.329341 --- ParallelTerminationStrategy: PID 13562 died... 02:24:38.348193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Terminated: ok {rc=0} 02:24:38.393081 --- ParallelTerminationStrategy: PID 13563 died... 02:24:38.411715 run iperf3-srv_10.42.42.10(pid=13563): Terminated {rc=256} 02:24:38.456413 --- ParallelTerminationStrategy: PID 13564 died... 02:24:38.475320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminated: ok {rc=0} 02:24:38.520381 --- ParallelTerminationStrategy: PID 13565 died... 02:24:38.539234 run iperf3-srv_10.42.42.10(pid=13565): Terminated {rc=256} 02:24:38.584240 --- ParallelTerminationStrategy: PID 13566 died... 02:24:38.603094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Terminated: ok {rc=0} 02:24:38.648086 --- ParallelTerminationStrategy: PID 13567 died... 02:24:38.667017 run iperf3-srv_10.42.42.10(pid=13567): Terminated {rc=256} 02:24:38.711858 --- ParallelTerminationStrategy: PID 13570 died... 02:24:38.730786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13570): Terminated: ok {rc=0} 02:24:38.776148 --- ParallelTerminationStrategy: PID 13573 died... 02:24:38.795070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13573): Terminated: ok {rc=0} 02:24:38.840102 --- ParallelTerminationStrategy: PID 13576 died... 02:24:38.859077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13576): Terminated: ok {rc=0} 02:24:38.944322 bus /gobi_4: Setting Powered False 02:24:40.043914 bus /gobi_4: Setting Powered False 02:24:41.161587 bus /gobi_1: Setting Powered False 02:24:42.261859 bus /gobi_1: Setting Powered False 02:24:43.378453 bus /gobi_0: Setting Powered False 02:24:44.477245 bus /gobi_0: Setting Powered False 02:24:45.594748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:24:46.696220 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.708585 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:46.769052 tst ping.py: using LAC 25332 02:24:46.890341 tst ping.py: using RAC 87 02:24:47.009825 tst ping.py: using CellId 25332 02:24:47.159999 tst ping.py: using BVCI 25333 02:24:47.276690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.288224 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.299532 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.310890 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.322349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.333543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.344735 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.355782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:47.471769 tst ping.py:19: start network... 02:24:47.686606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:48.176841 run create_hlr_db(pid=13578): Launched 02:24:48.306469 bus /gobi_6: Setting Powered False 02:24:49.369313 run create_hlr_db(pid=13578): Terminated: ok {rc=0} 02:24:49.812697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13580): Launched 02:24:50.130049 run osmo-hlr_10.42.42.2(pid=13581): Launched 02:24:50.250655 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:50.805384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13583): Launched 02:24:51.123682 run osmo-stp_10.42.42.5(pid=13584): Launched 02:24:51.244583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:51.798339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13586): Launched 02:24:51.921049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:52.189465 run patchelf(pid=13587): Launched 02:24:52.367294 run osmo-stp_10.42.42.5(pid=13584): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13584)] 02:24:52.502069 run osmo-stp_10.42.42.5(pid=13584): stdout: | (launched: 2022-12-10_02:24:51.066011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:52.639145 run osmo-stp_10.42.42.5(pid=13584): stderr: | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022451258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:52.775657 run osmo-stp_10.42.42.5(pid=13584): stdout: | (launched: 2022-12-10_02:24:51.066011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:52.906655 run osmo-stp_10.42.42.5(pid=13584): stderr: | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022451257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022451258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022451258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:53.060818 run patchelf(pid=13587): Terminating (SIGINT) 02:24:53.239057 run patchelf(pid=13587): Terminated: ok {rc=0} 02:24:53.367364 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13584): Process ended prematurely: osmo-stp_10.42.42.5(pid=13584) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13584)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 02:24:53.376676 tst ping.py:22: Test FAILED (6.7 sec) 02:24:53.404786 run osmo-hlr_10.42.42.2(pid=13581): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13581)] 02:24:53.455295 run osmo-hlr_10.42.42.2(pid=13581): stdout: | (launched: 2022-12-10_02:24:50.072422) 02:24:53.506904 run osmo-hlr_10.42.42.2(pid=13581): stderr: | [0;m[1;31m20221210022450269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022450269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022450269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022450269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022450269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022450270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022450282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022450290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022450291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022450291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:53.559628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13580): Terminating (SIGTERM) 02:24:53.601661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13583): Terminating (SIGTERM) 02:24:53.643698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13586): Terminating (SIGTERM) 02:24:53.686234 --- ParallelTerminationStrategy: PID 13580 died... 02:24:53.706478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13580): Terminated: ok {rc=0} 02:24:53.753156 --- ParallelTerminationStrategy: PID 13583 died... 02:24:53.773133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13583): Terminated: ok {rc=0} 02:24:53.819701 --- ParallelTerminationStrategy: PID 13586 died... 02:24:53.839454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13586): Terminated: ok {rc=0} 02:24:53.927808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:24:55.015931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.027934 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:55.089394 tst ping_idle_ping.py: using LAC 25333 02:24:55.215812 tst ping_idle_ping.py: using RAC 88 02:24:55.341370 tst ping_idle_ping.py: using CellId 25333 02:24:55.466118 tst ping_idle_ping.py: using BVCI 25334 02:24:55.582558 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.594163 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.605463 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.617294 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.628903 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.640602 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.652504 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:55.664223 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:55.783776 tst ping_idle_ping.py:24: start network... 02:24:56.000086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:56.497664 run create_hlr_db(pid=13588): Launched 02:24:56.627615 bus /gobi_6: Setting Powered False 02:24:57.690161 run create_hlr_db(pid=13588): Terminated: ok {rc=0} 02:24:58.114077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13590): Launched 02:24:58.411517 run osmo-hlr_10.42.42.2(pid=13591): Launched 02:24:58.525825 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:59.053077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13593): Launched 02:24:59.350802 run osmo-stp_10.42.42.5(pid=13594): Launched 02:24:59.464663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:59.978056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13596): Launched 02:25:00.092568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:00.343744 run patchelf(pid=13597): Launched 02:25:00.510820 run osmo-stp_10.42.42.5(pid=13594): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13594)] 02:25:00.637960 run osmo-stp_10.42.42.5(pid=13594): stdout: | (launched: 2022-12-10_02:24:59.296898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:00.766120 run osmo-stp_10.42.42.5(pid=13594): stderr: | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022459467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:00.918579 run osmo-stp_10.42.42.5(pid=13594): stdout: | (launched: 2022-12-10_02:24:59.296898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:01.043643 run osmo-stp_10.42.42.5(pid=13594): stderr: | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022459466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022459467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022459467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:01.192147 run patchelf(pid=13597): Terminating (SIGINT) 02:25:01.363542 run patchelf(pid=13597): Terminated: ok {rc=0} 02:25:01.487316 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13594): Process ended prematurely: osmo-stp_10.42.42.5(pid=13594) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13594)] [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:25:01.497308 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:25:01.527348 run osmo-hlr_10.42.42.2(pid=13591): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13591)] 02:25:01.577631 run osmo-hlr_10.42.42.2(pid=13591): stdout: | (launched: 2022-12-10_02:24:58.357723) 02:25:01.630056 run osmo-hlr_10.42.42.2(pid=13591): stderr: | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022458534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022458547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022458555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022458555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022458555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:01.682877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13590): Terminating (SIGTERM) 02:25:01.724937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13593): Terminating (SIGTERM) 02:25:01.766949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13596): Terminating (SIGTERM) 02:25:01.820642 --- ParallelTerminationStrategy: PID 13590 died... 02:25:01.840589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13590): Terminated: ok {rc=0} 02:25:01.888610 --- ParallelTerminationStrategy: PID 13593 died... 02:25:01.911140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13593): Terminated: ok {rc=0} 02:25:01.958690 --- ParallelTerminationStrategy: PID 13596 died... 02:25:01.978292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13596): Terminated: ok {rc=0} 02:25:02.076181 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:25:03.377375 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:03.383898 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:25:03.405089 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:25:03.440741 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:25:03.491423 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:25:03.511771 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:25:03.546512 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:25:04.105563 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:25:04.111970 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.124534 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:25:04.180703 tst switch_tch_pdch.py: using LAC 25334 02:25:04.303257 tst switch_tch_pdch.py: using RAC 89 02:25:04.425752 tst switch_tch_pdch.py: using CellId 25334 02:25:04.548461 tst switch_tch_pdch.py: using BVCI 25335 02:25:04.663538 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.675153 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.686499 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.697911 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.709107 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.720477 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.732058 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:04.743354 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:04.860227 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:04.976091 tst switch_tch_pdch.py:51: start network... 02:25:05.174878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:05.634946 run create_hlr_db(pid=13604): Launched 02:25:05.750134 bus /gobi_6: Setting Powered False 02:25:06.808909 run create_hlr_db(pid=13604): Terminated: ok {rc=0} 02:25:07.224051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Launched 02:25:07.521238 run osmo-hlr_10.42.42.2(pid=13607): Launched 02:25:07.634884 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:08.144833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Launched 02:25:08.442137 run osmo-stp_10.42.42.5(pid=13610): Launched 02:25:08.555109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:09.066087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Launched 02:25:09.180152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:09.430823 run patchelf(pid=13613): Launched 02:25:09.597072 run osmo-stp_10.42.42.5(pid=13610): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] 02:25:09.723288 run osmo-stp_10.42.42.5(pid=13610): stdout: | (launched: 2022-12-10_02:25:08.387779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:09.851185 run osmo-stp_10.42.42.5(pid=13610): stderr: | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022508559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:09.979570 run osmo-stp_10.42.42.5(pid=13610): stdout: | (launched: 2022-12-10_02:25:08.387779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:10.101931 run osmo-stp_10.42.42.5(pid=13610): stderr: | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022508558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022508559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022508559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:10.246710 run patchelf(pid=13613): Terminating (SIGINT) 02:25:10.414018 run patchelf(pid=13613): Terminated: ok {rc=0} 02:25:10.534520 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13610): Process ended prematurely: osmo-stp_10.42.42.5(pid=13610) [trial-2368↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] [trial-2368↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:25:10.543151 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 02:25:10.570224 run osmo-hlr_10.42.42.2(pid=13607): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13607)] 02:25:10.618451 run osmo-hlr_10.42.42.2(pid=13607): stdout: | (launched: 2022-12-10_02:25:07.466946) 02:25:10.668247 run osmo-hlr_10.42.42.2(pid=13607): stderr: | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022507644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022507656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022507666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022507666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022507666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:10.718694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Terminating (SIGTERM) 02:25:10.758741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Terminating (SIGTERM) 02:25:10.798747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Terminating (SIGTERM) 02:25:10.838881 --- ParallelTerminationStrategy: PID 13606 died... 02:25:10.858060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13606): Terminated: ok {rc=0} 02:25:10.902432 --- ParallelTerminationStrategy: PID 13609 died... 02:25:10.921041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13609): Terminated: ok {rc=0} 02:25:10.965401 --- ParallelTerminationStrategy: PID 13612 died... 02:25:10.984165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13612): Terminated: ok {rc=0} 02:25:11.069844 bus /gobi_0: Setting Powered False 02:25:12.169314 bus /gobi_0: Setting Powered False 02:25:13.282885 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:25:14.522785 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:14.529246 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:25:14.550875 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:25:14.586670 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:25:14.641508 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:25:14.662989 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:25:14.697912 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:25:15.253228 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:25:15.258382 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.269634 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:25:15.326669 tst switch_tch_pdch.py: using LAC 25335 02:25:15.451003 tst switch_tch_pdch.py: using RAC 90 02:25:15.574916 tst switch_tch_pdch.py: using CellId 25335 02:25:15.704579 tst switch_tch_pdch.py: using BVCI 25336 02:25:15.819979 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.831338 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.856271 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.868000 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.886321 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.899872 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.912185 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:15.925416 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:16.048712 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:16.167173 tst switch_tch_pdch.py:51: start network... 02:25:16.378257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:16.883290 run create_hlr_db(pid=13618): Launched 02:25:17.039924 bus /gobi_6: Setting Powered False 02:25:18.098902 run create_hlr_db(pid=13618): Terminated: ok {rc=0} 02:25:18.487323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Launched 02:25:18.782133 run osmo-hlr_10.42.42.2(pid=13621): Launched 02:25:18.894507 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:19.375416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Launched 02:25:19.670558 run osmo-stp_10.42.42.5(pid=13624): Launched 02:25:19.783297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:20.267019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Launched 02:25:20.381112 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:20.630284 run patchelf(pid=13627): Launched 02:25:20.795824 run osmo-stp_10.42.42.5(pid=13624): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] 02:25:20.921213 run osmo-stp_10.42.42.5(pid=13624): stdout: | (launched: 2022-12-10_02:25:19.616218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:21.047955 run osmo-stp_10.42.42.5(pid=13624): stderr: | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022519786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:21.174983 run osmo-stp_10.42.42.5(pid=13624): stdout: | (launched: 2022-12-10_02:25:19.616218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:21.296379 run osmo-stp_10.42.42.5(pid=13624): stderr: | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022519785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022519786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022519786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:21.439743 run patchelf(pid=13627): Terminating (SIGINT) 02:25:21.605776 run patchelf(pid=13627): Terminated: ok {rc=0} 02:25:21.724786 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13624): Process ended prematurely: osmo-stp_10.42.42.5(pid=13624) [trial-2368↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] [trial-2368↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:25:21.733708 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:25:21.760572 run osmo-hlr_10.42.42.2(pid=13621): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13621)] 02:25:21.808659 run osmo-hlr_10.42.42.2(pid=13621): stdout: | (launched: 2022-12-10_02:25:18.728438) 02:25:21.858483 run osmo-hlr_10.42.42.2(pid=13621): stderr: | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022518905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022518918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022518926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022518927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022518927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:21.908446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Terminating (SIGTERM) 02:25:21.948573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Terminating (SIGTERM) 02:25:21.988574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Terminating (SIGTERM) 02:25:22.029188 --- ParallelTerminationStrategy: PID 13620 died... 02:25:22.048032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Terminated: ok {rc=0} 02:25:22.092667 --- ParallelTerminationStrategy: PID 13623 died... 02:25:22.111175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Terminated: ok {rc=0} 02:25:22.155331 --- ParallelTerminationStrategy: PID 13626 died... 02:25:22.173952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Terminated: ok {rc=0} 02:25:22.257303 bus /gobi_0: Setting Powered False 02:25:23.354886 bus /gobi_0: Setting Powered False 02:25:24.470829 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:trx-b200 --------------------------------------------------------------------- 02:25:25.707470 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:25.711600 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:25.745874 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:25:25.752745 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:25:25.806454 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:25.840315 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:25:25.847194 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:25:26.386993 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:25:26.392052 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 02:25:26.403044 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 02:25:26.452787 tst mo_mt_sms.py: using LAC 25336 02:25:26.577440 tst mo_mt_sms.py: using RAC 91 02:25:26.700812 tst mo_mt_sms.py: using CellId 25336 02:25:26.825194 tst mo_mt_sms.py: using BVCI 25337 02:25:26.939929 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:27.054363 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:27.167594 tst mo_mt_sms.py:9: start nitb and bts... 02:25:27.368395 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:25:27.975312 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13631): Launched 02:25:28.272704 run osmo-nitb_10.42.42.2(pid=13632): Launched 02:25:28.437927 run osmo-nitb_10.42.42.2(pid=13632): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13632)] 02:25:28.572191 run osmo-nitb_10.42.42.2(pid=13632): stdout: | (launched: 2022-12-10_02:25:28.218144) 02:25:28.707413 run osmo-nitb_10.42.42.2(pid=13632): stderr: | (launched: 2022-12-10_02:25:28.262586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:28.842649 run osmo-nitb_10.42.42.2(pid=13632): stdout: | (launched: 2022-12-10_02:25:28.218144) 02:25:28.972225 run osmo-nitb_10.42.42.2(pid=13632): stderr: | (launched: 2022-12-10_02:25:28.262586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13632): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13632) [trial-2368↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13632)] 02:25:29.385808 tst osmo-nitb_10.42.42.2(pid=13632): stdout: | (launched: 2022-12-10_02:25:28.218144) 02:25:29.505174 tst osmo-nitb_10.42.42.2(pid=13632): stderr: | (launched: 2022-12-10_02:25:28.262586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:29.646300 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13632): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13632) [trial-2368↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13632)] [trial-2368↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 02:25:29.654729 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:25:29.661348 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13631): Terminating (SIGTERM) 02:25:29.870630 --- ParallelTerminationStrategy: PID 13631 died... 02:25:29.890956 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13631): Terminated: ok {rc=0} 02:25:29.977510 bus /sierra_3: Setting Powered False 02:25:31.077688 bus /sierra_3: Setting Powered False 02:25:32.198755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:trx-b200 --------------------------------------------------------------------- 02:25:33.397074 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:33.401132 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:33.435176 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:25:33.462293 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:25:33.514898 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:33.548808 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:25:33.575451 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:25:34.118936 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:25:34.124145 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.134881 tst sms:trx-b200: Using 1 x bts (candidates: 1) 02:25:34.182952 tst mo_mt_sms.py: using LAC 25337 02:25:34.302237 tst mo_mt_sms.py: using RAC 92 02:25:34.420865 tst mo_mt_sms.py: using CellId 25337 02:25:34.545545 tst mo_mt_sms.py: using BVCI 25338 02:25:34.655759 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.666566 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.677005 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.687863 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.698593 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:34.709428 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:34.828094 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:34.943589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:35.403496 run create_hlr_db(pid=13636): Launched 02:25:35.517125 bus /sierra_2: Setting Powered False 02:25:36.576238 run create_hlr_db(pid=13636): Terminated: ok {rc=0} 02:25:36.992404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13638): Launched 02:25:37.289690 run osmo-hlr_10.42.42.2(pid=13639): Launched 02:25:37.403578 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:37.933028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13641): Launched 02:25:38.229562 run osmo-stp_10.42.42.5(pid=13642): Launched 02:25:38.343547 run osmo-msc_10.42.42.6: Starting osmo-msc 02:25:38.881055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13644): Launched 02:25:39.176838 run osmo-msc_10.42.42.6(pid=13645): Launched 02:25:39.343160 run osmo-stp_10.42.42.5(pid=13642): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13642)] 02:25:39.469219 run osmo-stp_10.42.42.5(pid=13642): stdout: | (launched: 2022-12-10_02:25:38.175615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:39.595677 run osmo-stp_10.42.42.5(pid=13642): stderr: | [0;m[38;5;43m20221210022538344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022538344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022538345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022538345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:39.719684 run osmo-stp_10.42.42.5(pid=13642): stdout: | (launched: 2022-12-10_02:25:38.175615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:39.837329 run osmo-stp_10.42.42.5(pid=13642): stderr: | [0;m[38;5;43m20221210022538344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022538344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022538345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022538345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022538346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:39.978986 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13642): Process ended prematurely: osmo-stp_10.42.42.5(pid=13642) [trial-2368↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13642)] [trial-2368↪sms:trx-b200↪mo_mt_sms.py:16] 02:25:39.987219 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:25:40.013343 run osmo-hlr_10.42.42.2(pid=13639): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13639)] 02:25:40.061661 run osmo-hlr_10.42.42.2(pid=13639): stdout: | (launched: 2022-12-10_02:25:37.235600) 02:25:40.111427 run osmo-hlr_10.42.42.2(pid=13639): stderr: | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022537409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022537421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022537429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022537430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022537430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:40.180989 run osmo-msc_10.42.42.6(pid=13645): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13645)] 02:25:40.229111 run osmo-msc_10.42.42.6(pid=13645): stdout: | (launched: 2022-12-10_02:25:39.122783) 02:25:40.278572 run osmo-msc_10.42.42.6(pid=13645): stderr: | [0;m[38;5;43m20221210022539392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022539393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c84d2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022539393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022539393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022539393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022539393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022539395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022539396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022539396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022539396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:25:40.328401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13638): Terminating (SIGTERM) 02:25:40.368523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13641): Terminating (SIGTERM) 02:25:40.408677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13644): Terminating (SIGTERM) 02:25:40.448867 --- ParallelTerminationStrategy: PID 13638 died... 02:25:40.468131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13638): Terminated: ok {rc=0} 02:25:40.512591 --- ParallelTerminationStrategy: PID 13641 died... 02:25:40.531201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13641): Terminated: ok {rc=0} 02:25:40.575615 --- ParallelTerminationStrategy: PID 13644 died... 02:25:40.594361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13644): Terminated: ok {rc=0} 02:25:40.678189 bus /sierra_3: Setting Powered False 02:25:41.773535 bus /sierra_3: Setting Powered False 02:25:42.888731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-b200 --------------------------------------------------------------------- 02:25:44.120670 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:44.124667 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:44.158803 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:25:44.165740 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:25:44.200497 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:44.234340 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:25:44.241299 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:25:44.762824 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:25:44.767863 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 02:25:44.778909 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 02:25:44.827897 tst assert_extension.py: using LAC 25338 02:25:44.952522 tst assert_extension.py: using RAC 93 02:25:45.074826 tst assert_extension.py: using CellId 25338 02:25:45.197357 tst assert_extension.py: using BVCI 25339 02:25:45.312110 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 02:25:45.425644 tst assert_extension.py:10: start nitb and bts... 02:25:45.623235 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:25:46.260368 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Launched 02:25:46.581658 run osmo-nitb_10.42.42.2(pid=13652): Launched 02:25:46.774309 run osmo-nitb_10.42.42.2(pid=13652): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] 02:25:46.909731 run osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-10_02:25:46.517283) 02:25:47.099897 run osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-10_02:25:46.561912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:47.241068 run osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-10_02:25:46.517283) 02:25:47.371316 run osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-10_02:25:46.561912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2368↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] 02:25:47.721023 tst osmo-nitb_10.42.42.2(pid=13652): stdout: | (launched: 2022-12-10_02:25:46.517283) 02:25:47.840179 tst osmo-nitb_10.42.42.2(pid=13652): stderr: | (launched: 2022-12-10_02:25:46.561912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:47.981170 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2368↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] [trial-2368↪nitb_ussd:trx-b200↪assert_extension.py:12] 02:25:47.989306 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:25:47.995672 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Terminating (SIGTERM) 02:25:48.205345 --- ParallelTerminationStrategy: PID 13651 died... 02:25:48.225710 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13651): Terminated: ok {rc=0} 02:25:48.312803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:trx-b200 --------------------------------------------------------------------- 02:25:49.488695 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:49.493977 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:49.527824 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:25:49.554931 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:25:49.591057 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:49.624614 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:25:49.651732 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:25:50.181063 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:25:50.186051 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.196791 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 02:25:50.245130 tst assert_extension.py: using LAC 25339 02:25:50.363174 tst assert_extension.py: using RAC 94 02:25:50.480420 tst assert_extension.py: using CellId 25339 02:25:50.598595 tst assert_extension.py: using BVCI 25340 02:25:50.708080 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.718771 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.729328 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.740359 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.751159 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:50.761822 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 02:25:50.881574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:51.339189 run create_hlr_db(pid=13657): Launched 02:25:51.452100 bus /sierra_2: Setting Powered False 02:25:52.515118 run create_hlr_db(pid=13657): Terminated: ok {rc=0} 02:25:52.941137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Launched 02:25:53.237466 run osmo-hlr_10.42.42.2(pid=13660): Launched 02:25:53.350639 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:53.877167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Launched 02:25:54.173004 run osmo-stp_10.42.42.5(pid=13663): Launched 02:25:54.286568 run osmo-msc_10.42.42.6: Starting osmo-msc 02:25:54.819177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Launched 02:25:55.114549 run osmo-msc_10.42.42.6(pid=13666): Launched 02:25:55.279721 run osmo-stp_10.42.42.5(pid=13663): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] 02:25:55.404941 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-10_02:25:54.119145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:55.531079 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221210022554287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022554288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022554288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022554288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:55.654828 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-10_02:25:54.119145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:55.772541 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221210022554287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022554288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022554288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022554288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022554289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:55.913711 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2368↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] [trial-2368↪ussd:trx-b200↪assert_extension.py:17] 02:25:55.921912 tst assert_extension.py:17: Test FAILED (5.7 sec) 02:25:55.947935 run osmo-hlr_10.42.42.2(pid=13660): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13660)] 02:25:55.996071 run osmo-hlr_10.42.42.2(pid=13660): stdout: | (launched: 2022-12-10_02:25:53.183437) 02:25:56.045847 run osmo-hlr_10.42.42.2(pid=13660): stderr: | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022553360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022553371 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022553379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022553380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022553380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:56.115044 run osmo-msc_10.42.42.6(pid=13666): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13666)] 02:25:56.162837 run osmo-msc_10.42.42.6(pid=13666): stdout: | (launched: 2022-12-10_02:25:55.060375) 02:25:56.212423 run osmo-msc_10.42.42.6(pid=13666): stderr: | [0;m[38;5;43m20221210022555332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022555332 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b08b2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022555332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022555332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022555333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022555333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022555335 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022555335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:25:56.262467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminating (SIGTERM) 02:25:56.302614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminating (SIGTERM) 02:25:56.342487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Terminating (SIGTERM) 02:25:56.382507 --- ParallelTerminationStrategy: PID 13659 died... 02:25:56.401743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminated: ok {rc=0} 02:25:56.446300 --- ParallelTerminationStrategy: PID 13662 died... 02:25:56.464793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminated: ok {rc=0} 02:25:56.509205 --- ParallelTerminationStrategy: PID 13665 died... 02:25:56.527740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13665): Terminated: ok {rc=0} 02:25:56.614833 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:25:57.826270 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:57.834645 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:25:57.868939 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:25:57.896278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:25:57.948871 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:25:57.982715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:25:58.009941 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:25:58.567181 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:25:58.622286 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:58.633906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:25:58.703610 tst mo_mt_call.py: using LAC 25340 02:25:58.830909 tst mo_mt_call.py: using RAC 95 02:25:58.960309 tst mo_mt_call.py: using CellId 25340 02:25:59.086479 tst mo_mt_call.py: using BVCI 25341 02:25:59.203733 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:59.215076 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:59.226356 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:59.237739 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:59.249041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:25:59.260245 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:25:59.381454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:25:59.499993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:00.001700 run create_hlr_db(pid=13671): Launched 02:26:00.133979 bus /sierra_2: Setting Powered False 02:26:01.193570 run create_hlr_db(pid=13671): Terminated: ok {rc=0} 02:26:01.690508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13673): Launched 02:26:02.044450 run osmo-hlr_10.42.42.2(pid=13674): Launched 02:26:02.285798 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:02.842576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13676): Launched 02:26:03.166280 run osmo-stp_10.42.42.5(pid=13677): Launched 02:26:03.290084 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:03.877615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13679): Launched 02:26:04.202268 run osmo-msc_10.42.42.6(pid=13680): Launched 02:26:04.384647 run osmo-stp_10.42.42.5(pid=13677): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13677)] 02:26:04.521541 run osmo-stp_10.42.42.5(pid=13677): stdout: | (launched: 2022-12-10_02:26:03.107652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:04.659305 run osmo-stp_10.42.42.5(pid=13677): stderr: | [0;m[38;5;43m20221210022603300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022603300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022603301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022603301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:04.795811 run osmo-stp_10.42.42.5(pid=13677): stdout: | (launched: 2022-12-10_02:26:03.107652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:04.924681 run osmo-stp_10.42.42.5(pid=13677): stderr: | [0;m[38;5;43m20221210022603300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022603300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022603301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022603301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022603302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:05.078708 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13677): Process ended prematurely: osmo-stp_10.42.42.5(pid=13677) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13677)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:26:05.088051 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:26:05.115843 run osmo-hlr_10.42.42.2(pid=13674): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13674)] 02:26:05.166384 run osmo-hlr_10.42.42.2(pid=13674): stdout: | (launched: 2022-12-10_02:26:01.971735) 02:26:05.218829 run osmo-hlr_10.42.42.2(pid=13674): stderr: | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022602177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022602198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022602208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022602208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022602208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:05.291437 run osmo-msc_10.42.42.6(pid=13680): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13680)] 02:26:05.342064 run osmo-msc_10.42.42.6(pid=13680): stdout: | (launched: 2022-12-10_02:26:04.143457) 02:26:05.394066 run osmo-msc_10.42.42.6(pid=13680): stderr: | [0;m[38;5;43m20221210022604465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022604465 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0b6677c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022604465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022604465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022604465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022604466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022604469 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022604469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022604470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022604470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:05.446619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13673): Terminating (SIGTERM) 02:26:05.488626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13676): Terminating (SIGTERM) 02:26:05.530846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13679): Terminating (SIGTERM) 02:26:05.573372 --- ParallelTerminationStrategy: PID 13673 died... 02:26:05.593429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13673): Terminated: ok {rc=0} 02:26:05.639990 --- ParallelTerminationStrategy: PID 13676 died... 02:26:05.659720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13676): Terminated: ok {rc=0} 02:26:05.706154 --- ParallelTerminationStrategy: PID 13679 died... 02:26:05.725944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13679): Terminated: ok {rc=0} 02:26:05.814557 bus /sierra_3: Setting Powered False 02:26:06.913248 bus /sierra_3: Setting Powered False 02:26:08.029316 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:26:09.178507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.190515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:26:09.263636 tst mo_mt_call_osmux.py: using LAC 25341 02:26:09.392004 tst mo_mt_call_osmux.py: using RAC 96 02:26:09.513438 tst mo_mt_call_osmux.py: using CellId 25341 02:26:09.641754 tst mo_mt_call_osmux.py: using BVCI 25342 02:26:09.753418 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.764473 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.775566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.786792 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.798222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:09.809509 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:09.928002 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:10.044197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:10.512633 run create_hlr_db(pid=13682): Launched 02:26:10.628747 bus /sierra_2: Setting Powered False 02:26:11.689102 run create_hlr_db(pid=13682): Terminated: ok {rc=0} 02:26:12.109629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Launched 02:26:12.412871 run osmo-hlr_10.42.42.2(pid=13685): Launched 02:26:12.528857 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:13.051290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Launched 02:26:13.353436 run osmo-stp_10.42.42.5(pid=13688): Launched 02:26:13.470268 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:14.018172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Launched 02:26:14.319555 run osmo-msc_10.42.42.6(pid=13691): Launched 02:26:14.489163 run osmo-stp_10.42.42.5(pid=13688): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] 02:26:14.617362 run osmo-stp_10.42.42.5(pid=13688): stdout: | (launched: 2022-12-10_02:26:13.298692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:14.745511 run osmo-stp_10.42.42.5(pid=13688): stderr: | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022613468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022613468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022613468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022613469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:14.871555 run osmo-stp_10.42.42.5(pid=13688): stdout: | (launched: 2022-12-10_02:26:13.298692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:14.990907 run osmo-stp_10.42.42.5(pid=13688): stderr: | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022613467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022613468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022613468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022613468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022613469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:15.134216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13688): Process ended prematurely: osmo-stp_10.42.42.5(pid=13688) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:26:15.142947 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:26:15.169361 run osmo-hlr_10.42.42.2(pid=13685): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13685)] 02:26:15.217208 run osmo-hlr_10.42.42.2(pid=13685): stdout: | (launched: 2022-12-10_02:26:12.357402) 02:26:15.266467 run osmo-hlr_10.42.42.2(pid=13685): stderr: | [0;m[1;31m20221210022612532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022612532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022612532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022612533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022612533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022612533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022612544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022612553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022612553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022612553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:15.335090 run osmo-msc_10.42.42.6(pid=13691): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13691)] 02:26:15.382558 run osmo-msc_10.42.42.6(pid=13691): stdout: | (launched: 2022-12-10_02:26:14.264739) 02:26:15.431607 run osmo-msc_10.42.42.6(pid=13691): stderr: | [0;m[38;5;43m20221210022614534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022614535 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f495ab7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022614535 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022614535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022614535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022614535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022614537 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022614537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022614538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022614538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:15.480943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Terminating (SIGTERM) 02:26:15.520406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Terminating (SIGTERM) 02:26:15.559937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Terminating (SIGTERM) 02:26:15.599707 --- ParallelTerminationStrategy: PID 13684 died... 02:26:15.618763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13684): Terminated: ok {rc=0} 02:26:15.662641 --- ParallelTerminationStrategy: PID 13687 died... 02:26:15.681347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13687): Terminated: ok {rc=0} 02:26:15.725692 --- ParallelTerminationStrategy: PID 13690 died... 02:26:15.744161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13690): Terminated: ok {rc=0} 02:26:15.829614 bus /sierra_3: Setting Powered False 02:26:16.941614 bus /sierra_3: Setting Powered False 02:26:18.073131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:26:19.321115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:19.327345 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:26:19.360915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:26:19.387588 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:26:19.438963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:26:19.471741 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:26:19.497943 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:26:20.049199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:26:20.097471 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.108436 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:26:20.180148 tst mo_mt_call.py: using LAC 25342 02:26:20.298916 tst mo_mt_call.py: using RAC 97 02:26:20.416371 tst mo_mt_call.py: using CellId 25342 02:26:20.533393 tst mo_mt_call.py: using BVCI 25343 02:26:20.642571 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.653576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.664487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.675598 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.686726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:20.697771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:20.816880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:20.935055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:21.403155 run create_hlr_db(pid=13696): Launched 02:26:21.519115 bus /sierra_2: Setting Powered False 02:26:22.579529 run create_hlr_db(pid=13696): Terminated: ok {rc=0} 02:26:23.001246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13698): Launched 02:26:23.303622 run osmo-hlr_10.42.42.2(pid=13699): Launched 02:26:23.419928 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:23.950201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13701): Launched 02:26:24.250844 run osmo-stp_10.42.42.5(pid=13702): Launched 02:26:24.366490 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:24.911668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13704): Launched 02:26:25.214585 run osmo-msc_10.42.42.6(pid=13705): Launched 02:26:25.383862 run osmo-stp_10.42.42.5(pid=13702): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13702)] 02:26:25.512155 run osmo-stp_10.42.42.5(pid=13702): stdout: | (launched: 2022-12-10_02:26:24.195898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:25.641506 run osmo-stp_10.42.42.5(pid=13702): stderr: | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022624367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:25.767606 run osmo-stp_10.42.42.5(pid=13702): stdout: | (launched: 2022-12-10_02:26:24.195898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:25.887428 run osmo-stp_10.42.42.5(pid=13702): stderr: | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022624367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022624367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022624368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:26.030935 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13702): Process ended prematurely: osmo-stp_10.42.42.5(pid=13702) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13702)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:26:26.039820 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:26:26.066669 run osmo-hlr_10.42.42.2(pid=13699): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13699)] 02:26:26.114295 run osmo-hlr_10.42.42.2(pid=13699): stdout: | (launched: 2022-12-10_02:26:23.248735) 02:26:26.163591 run osmo-hlr_10.42.42.2(pid=13699): stderr: | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022623426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022623438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022623446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022623446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022623446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:26.231847 run osmo-msc_10.42.42.6(pid=13705): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13705)] 02:26:26.279282 run osmo-msc_10.42.42.6(pid=13705): stdout: | (launched: 2022-12-10_02:26:25.158733) 02:26:26.329167 run osmo-msc_10.42.42.6(pid=13705): stderr: | [0;m[38;5;43m20221210022625430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022625430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b918e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022625431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022625431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022625431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022625431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022625433 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022625433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022625433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022625434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:26.378681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13698): Terminating (SIGTERM) 02:26:26.418372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13701): Terminating (SIGTERM) 02:26:26.458352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13704): Terminating (SIGTERM) 02:26:26.498571 --- ParallelTerminationStrategy: PID 13698 died... 02:26:26.517850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13698): Terminated: ok {rc=0} 02:26:26.562145 --- ParallelTerminationStrategy: PID 13701 died... 02:26:26.580680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13701): Terminated: ok {rc=0} 02:26:26.625173 --- ParallelTerminationStrategy: PID 13704 died... 02:26:26.643638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13704): Terminated: ok {rc=0} 02:26:26.727717 bus /sierra_3: Setting Powered False 02:26:27.822885 bus /sierra_3: Setting Powered False 02:26:28.935678 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:26:30.078381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.090161 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:26:30.159833 tst mo_mt_call_osmux.py: using LAC 25343 02:26:30.278311 tst mo_mt_call_osmux.py: using RAC 98 02:26:30.398427 tst mo_mt_call_osmux.py: using CellId 25343 02:26:30.518324 tst mo_mt_call_osmux.py: using BVCI 25344 02:26:30.630849 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.642046 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.653148 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.664477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.675804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:30.687083 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:30.803569 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:30.962859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:31.511372 run create_hlr_db(pid=13707): Launched 02:26:31.634228 bus /sierra_2: Setting Powered False 02:26:32.694319 run create_hlr_db(pid=13707): Terminated: ok {rc=0} 02:26:33.136801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Launched 02:26:33.462170 run osmo-hlr_10.42.42.2(pid=13710): Launched 02:26:33.586581 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:34.146437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Launched 02:26:34.470234 run osmo-stp_10.42.42.5(pid=13713): Launched 02:26:34.594261 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:35.182350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Launched 02:26:35.505033 run osmo-msc_10.42.42.6(pid=13716): Launched 02:26:35.687333 run osmo-stp_10.42.42.5(pid=13713): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] 02:26:35.824061 run osmo-stp_10.42.42.5(pid=13713): stdout: | (launched: 2022-12-10_02:26:34.411912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:35.962302 run osmo-stp_10.42.42.5(pid=13713): stderr: | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022634603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:36.098811 run osmo-stp_10.42.42.5(pid=13713): stdout: | (launched: 2022-12-10_02:26:34.411912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:36.227197 run osmo-stp_10.42.42.5(pid=13713): stderr: | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022634603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022634603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022634604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:36.380911 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13713): Process ended prematurely: osmo-stp_10.42.42.5(pid=13713) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:26:36.390547 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:26:36.418472 run osmo-hlr_10.42.42.2(pid=13710): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13710)] 02:26:36.468866 run osmo-hlr_10.42.42.2(pid=13710): stdout: | (launched: 2022-12-10_02:26:33.403206) 02:26:36.520798 run osmo-hlr_10.42.42.2(pid=13710): stderr: | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022633600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022633613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022633621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022633621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022633621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:36.594035 run osmo-msc_10.42.42.6(pid=13716): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13716)] 02:26:36.644241 run osmo-msc_10.42.42.6(pid=13716): stdout: | (launched: 2022-12-10_02:26:35.446382) 02:26:36.695814 run osmo-msc_10.42.42.6(pid=13716): stderr: | [0;m[38;5;43m20221210022635772 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022635772 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f372d908c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022635772 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022635772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022635772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022635773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022635774 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022635775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022635775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022635775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:36.747887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Terminating (SIGTERM) 02:26:36.789644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Terminating (SIGTERM) 02:26:36.831259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Terminating (SIGTERM) 02:26:36.873232 --- ParallelTerminationStrategy: PID 13709 died... 02:26:36.893353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13709): Terminated: ok {rc=0} 02:26:36.939570 --- ParallelTerminationStrategy: PID 13712 died... 02:26:36.959227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13712): Terminated: ok {rc=0} 02:26:37.005350 --- ParallelTerminationStrategy: PID 13715 died... 02:26:37.024749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13715): Terminated: ok {rc=0} 02:26:37.112830 bus /sierra_3: Setting Powered False 02:26:38.212735 bus /sierra_3: Setting Powered False 02:26:39.330849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:26:40.580612 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:40.586900 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:26:40.620155 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:26:40.646822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:26:40.695895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:26:40.728387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:26:40.754465 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:26:41.307835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:26:41.362960 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:41.374657 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:26:41.448700 tst mo_mt_call.py: using LAC 25344 02:26:41.575495 tst mo_mt_call.py: using RAC 99 02:26:41.701984 tst mo_mt_call.py: using CellId 25344 02:26:41.827475 tst mo_mt_call.py: using BVCI 25345 02:26:41.945395 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:41.956720 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:41.967978 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:41.979791 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:41.991607 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:42.003439 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:26:42.122264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:26:42.242940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:42.745155 run create_hlr_db(pid=13721): Launched 02:26:42.876902 bus /sierra_2: Setting Powered False 02:26:43.940265 run create_hlr_db(pid=13721): Terminated: ok {rc=0} 02:26:44.370954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13723): Launched 02:26:44.675786 run osmo-hlr_10.42.42.2(pid=13724): Launched 02:26:44.791996 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:45.329917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Launched 02:26:45.633185 run osmo-stp_10.42.42.5(pid=13727): Launched 02:26:45.748859 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:46.363304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13729): Launched 02:26:46.717757 run osmo-msc_10.42.42.6(pid=13730): Launched 02:26:47.012533 run osmo-stp_10.42.42.5(pid=13727): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] 02:26:47.364450 run osmo-stp_10.42.42.5(pid=13727): stdout: | (launched: 2022-12-10_02:26:45.577777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:47.548053 run osmo-stp_10.42.42.5(pid=13727): stderr: | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022645750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:47.685492 run osmo-stp_10.42.42.5(pid=13727): stdout: | (launched: 2022-12-10_02:26:45.577777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:47.814289 run osmo-stp_10.42.42.5(pid=13727): stderr: | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022645750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022645750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022645751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:47.968688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13727): Process ended prematurely: osmo-stp_10.42.42.5(pid=13727) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:26:47.978307 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:26:48.007011 run osmo-hlr_10.42.42.2(pid=13724): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13724)] 02:26:48.057779 run osmo-hlr_10.42.42.2(pid=13724): stdout: | (launched: 2022-12-10_02:26:44.620073) 02:26:48.110091 run osmo-hlr_10.42.42.2(pid=13724): stderr: | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022644799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022644811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022644822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022644822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022644822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:48.182619 run osmo-msc_10.42.42.6(pid=13730): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13730)] 02:26:48.233222 run osmo-msc_10.42.42.6(pid=13730): stdout: | (launched: 2022-12-10_02:26:46.645968) 02:26:48.285456 run osmo-msc_10.42.42.6(pid=13730): stderr: | [0;m[38;5;43m20221210022647292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022647292 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f215c4bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022647292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022647292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022647293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022647293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022647294 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022647295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022647295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022647295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:48.338231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13723): Terminating (SIGTERM) 02:26:48.380353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Terminating (SIGTERM) 02:26:48.422771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13729): Terminating (SIGTERM) 02:26:48.465873 --- ParallelTerminationStrategy: PID 13723 died... 02:26:48.485595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13723): Terminated: ok {rc=0} 02:26:48.531913 --- ParallelTerminationStrategy: PID 13726 died... 02:26:48.551490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Terminated: ok {rc=0} 02:26:48.598197 --- ParallelTerminationStrategy: PID 13729 died... 02:26:48.617980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13729): Terminated: ok {rc=0} 02:26:48.706682 bus /sierra_3: Setting Powered False 02:26:49.804789 bus /sierra_3: Setting Powered False 02:26:50.922623 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:26:52.068717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.080608 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:26:52.150135 tst mo_mt_call_osmux.py: using LAC 25345 02:26:52.270262 tst mo_mt_call_osmux.py: using RAC 100 02:26:52.391196 tst mo_mt_call_osmux.py: using CellId 25345 02:26:52.511411 tst mo_mt_call_osmux.py: using BVCI 25346 02:26:52.621607 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.632490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.643387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.654481 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.666036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:52.676995 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:26:52.797046 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:26:52.914932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:53.382988 run create_hlr_db(pid=13732): Launched 02:26:53.498502 bus /sierra_2: Setting Powered False 02:26:54.558355 run create_hlr_db(pid=13732): Terminated: ok {rc=0} 02:26:54.998428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Launched 02:26:55.321377 run osmo-hlr_10.42.42.2(pid=13735): Launched 02:26:55.445879 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:56.005153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Launched 02:26:56.326664 run osmo-stp_10.42.42.5(pid=13738): Launched 02:26:56.449970 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:57.035087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Launched 02:26:57.359138 run osmo-msc_10.42.42.6(pid=13741): Launched 02:26:57.539660 run osmo-stp_10.42.42.5(pid=13738): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] 02:26:57.676352 run osmo-stp_10.42.42.5(pid=13738): stdout: | (launched: 2022-12-10_02:26:56.268131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:57.812714 run osmo-stp_10.42.42.5(pid=13738): stderr: | [0;m[38;5;43m20221210022656460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022656460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022656461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022656462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:57.948670 run osmo-stp_10.42.42.5(pid=13738): stdout: | (launched: 2022-12-10_02:26:56.268131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:58.077107 run osmo-stp_10.42.42.5(pid=13738): stderr: | [0;m[38;5;43m20221210022656460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022656460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022656461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022656462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022656463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:58.231032 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13738): Process ended prematurely: osmo-stp_10.42.42.5(pid=13738) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:26:58.240457 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:26:58.268239 run osmo-hlr_10.42.42.2(pid=13735): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13735)] 02:26:58.318032 run osmo-hlr_10.42.42.2(pid=13735): stdout: | (launched: 2022-12-10_02:26:55.263129) 02:26:58.369548 run osmo-hlr_10.42.42.2(pid=13735): stderr: | [0;m[1;31m20221210022655460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022655460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022655460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022655461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022655461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022655461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022655474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022655482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022655482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022655482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:58.441355 run osmo-msc_10.42.42.6(pid=13741): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13741)] 02:26:58.490897 run osmo-msc_10.42.42.6(pid=13741): stdout: | (launched: 2022-12-10_02:26:57.300164) 02:26:58.542962 run osmo-msc_10.42.42.6(pid=13741): stderr: | [0;m[38;5;43m20221210022657624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022657624 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b1410fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022657624 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022657624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022657624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022657624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022657626 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022657627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022657627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022657627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:58.595126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Terminating (SIGTERM) 02:26:58.637018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Terminating (SIGTERM) 02:26:58.678759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Terminating (SIGTERM) 02:26:58.720483 --- ParallelTerminationStrategy: PID 13734 died... 02:26:58.739973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13734): Terminated: ok {rc=0} 02:26:58.786286 --- ParallelTerminationStrategy: PID 13737 died... 02:26:58.805923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13737): Terminated: ok {rc=0} 02:26:58.851640 --- ParallelTerminationStrategy: PID 13740 died... 02:26:58.871122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13740): Terminated: ok {rc=0} 02:26:58.957741 bus /sierra_3: Setting Powered False 02:27:00.055401 bus /sierra_3: Setting Powered False 02:27:01.170447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:27:02.424891 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:02.431931 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:27:02.465495 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:27:02.493165 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:27:02.547668 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:27:02.581670 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:27:02.609333 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:27:03.159740 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:27:03.211231 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.222705 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:03.293767 tst mo_mt_call.py: using LAC 25346 02:27:03.422042 tst mo_mt_call.py: using RAC 101 02:27:03.549745 tst mo_mt_call.py: using CellId 25346 02:27:03.669725 tst mo_mt_call.py: using BVCI 25347 02:27:03.782275 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.793434 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.804348 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.816137 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.827466 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:03.838730 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:03.959349 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:04.078409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:04.580077 run create_hlr_db(pid=13746): Launched 02:27:04.712401 bus /sierra_2: Setting Powered False 02:27:05.776249 run create_hlr_db(pid=13746): Terminated: ok {rc=0} 02:27:06.206609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Launched 02:27:06.509556 run osmo-hlr_10.42.42.2(pid=13749): Launched 02:27:06.626928 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:07.158728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Launched 02:27:07.460747 run osmo-stp_10.42.42.5(pid=13752): Launched 02:27:07.578321 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:08.127343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13754): Launched 02:27:08.429317 run osmo-msc_10.42.42.6(pid=13755): Launched 02:27:08.600109 run osmo-stp_10.42.42.5(pid=13752): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13752)] 02:27:08.729702 run osmo-stp_10.42.42.5(pid=13752): stdout: | (launched: 2022-12-10_02:27:07.405457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:08.859559 run osmo-stp_10.42.42.5(pid=13752): stderr: | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022707574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:08.986615 run osmo-stp_10.42.42.5(pid=13752): stdout: | (launched: 2022-12-10_02:27:07.405457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:09.107266 run osmo-stp_10.42.42.5(pid=13752): stderr: | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022707574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022707574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022707577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:09.251160 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13752): Process ended prematurely: osmo-stp_10.42.42.5(pid=13752) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13752)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:27:09.260041 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:27:09.286699 run osmo-hlr_10.42.42.2(pid=13749): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13749)] 02:27:09.333999 run osmo-hlr_10.42.42.2(pid=13749): stdout: | (launched: 2022-12-10_02:27:06.454215) 02:27:09.383384 run osmo-hlr_10.42.42.2(pid=13749): stderr: | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022706628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022706640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022706648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022706648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022706648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:09.451856 run osmo-msc_10.42.42.6(pid=13755): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13755)] 02:27:09.499285 run osmo-msc_10.42.42.6(pid=13755): stdout: | (launched: 2022-12-10_02:27:08.374205) 02:27:09.549194 run osmo-msc_10.42.42.6(pid=13755): stderr: | [0;m[38;5;43m20221210022708647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022708647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c4909ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022708647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022708647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022708647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022708647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022708649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022708650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022708650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022708650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:09.598889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Terminating (SIGTERM) 02:27:09.638546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Terminating (SIGTERM) 02:27:09.678165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13754): Terminating (SIGTERM) 02:27:09.717976 --- ParallelTerminationStrategy: PID 13748 died... 02:27:09.736799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Terminated: ok {rc=0} 02:27:09.781089 --- ParallelTerminationStrategy: PID 13751 died... 02:27:09.799582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Terminated: ok {rc=0} 02:27:09.843302 --- ParallelTerminationStrategy: PID 13754 died... 02:27:09.861921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13754): Terminated: ok {rc=0} 02:27:09.945748 bus /sierra_3: Setting Powered False 02:27:11.041544 bus /sierra_3: Setting Powered False 02:27:12.156882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:27:13.302215 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.314047 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:13.383364 tst mo_mt_call_osmux.py: using LAC 25347 02:27:13.502323 tst mo_mt_call_osmux.py: using RAC 102 02:27:13.630441 tst mo_mt_call_osmux.py: using CellId 25347 02:27:13.764837 tst mo_mt_call_osmux.py: using BVCI 25348 02:27:13.877288 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.888376 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.899791 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.911102 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.922247 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:13.933663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:14.052852 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:14.170922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:14.638388 run create_hlr_db(pid=13757): Launched 02:27:14.754604 bus /sierra_2: Setting Powered False 02:27:15.814961 run create_hlr_db(pid=13757): Terminated: ok {rc=0} 02:27:16.293856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Launched 02:27:16.630352 run osmo-hlr_10.42.42.2(pid=13760): Launched 02:27:16.908380 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:17.543437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Launched 02:27:17.867161 run osmo-stp_10.42.42.5(pid=13763): Launched 02:27:17.985832 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:18.568745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Launched 02:27:18.892726 run osmo-msc_10.42.42.6(pid=13766): Launched 02:27:19.073775 run osmo-stp_10.42.42.5(pid=13763): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] 02:27:19.209941 run osmo-stp_10.42.42.5(pid=13763): stdout: | (launched: 2022-12-10_02:27:17.808641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:19.347551 run osmo-stp_10.42.42.5(pid=13763): stderr: | [0;m[38;5;43m20221210022717978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022717979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022717979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022717979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:19.484177 run osmo-stp_10.42.42.5(pid=13763): stdout: | (launched: 2022-12-10_02:27:17.808641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:19.612794 run osmo-stp_10.42.42.5(pid=13763): stderr: | [0;m[38;5;43m20221210022717978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022717979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022717979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022717979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022717980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:19.766515 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13763): Process ended prematurely: osmo-stp_10.42.42.5(pid=13763) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:27:19.775875 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:27:19.803571 run osmo-hlr_10.42.42.2(pid=13760): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13760)] 02:27:19.853519 run osmo-hlr_10.42.42.2(pid=13760): stdout: | (launched: 2022-12-10_02:27:16.560280) 02:27:19.905324 run osmo-hlr_10.42.42.2(pid=13760): stderr: | [0;m[1;31m20221210022716782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022716782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022716782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022716782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022716783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022716783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022716809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022716830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022716832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022716833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:19.977675 run osmo-msc_10.42.42.6(pid=13766): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13766)] 02:27:20.027926 run osmo-msc_10.42.42.6(pid=13766): stdout: | (launched: 2022-12-10_02:27:18.834198) 02:27:20.079817 run osmo-msc_10.42.42.6(pid=13766): stderr: | [0;m[38;5;43m20221210022719158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022719159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e87313c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022719159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022719159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022719159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022719159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022719161 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022719161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022719161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022719161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:20.131865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Terminating (SIGTERM) 02:27:20.173812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Terminating (SIGTERM) 02:27:20.215658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Terminating (SIGTERM) 02:27:20.258417 --- ParallelTerminationStrategy: PID 13759 died... 02:27:20.278504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13759): Terminated: ok {rc=0} 02:27:20.324893 --- ParallelTerminationStrategy: PID 13762 died... 02:27:20.344521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13762): Terminated: ok {rc=0} 02:27:20.391144 --- ParallelTerminationStrategy: PID 13765 died... 02:27:20.410829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13765): Terminated: ok {rc=0} 02:27:20.499364 bus /sierra_3: Setting Powered False 02:27:21.598779 bus /sierra_3: Setting Powered False 02:27:22.717288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:27:23.966194 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:23.973630 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:27:24.007533 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:27:24.035146 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:27:24.087447 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:27:24.121096 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:27:24.148314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:27:24.701904 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:27:24.753384 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:24.764924 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:27:24.835899 tst mo_mt_call.py: using LAC 25348 02:27:24.963539 tst mo_mt_call.py: using RAC 103 02:27:25.093056 tst mo_mt_call.py: using CellId 25348 02:27:25.221517 tst mo_mt_call.py: using BVCI 25349 02:27:25.333816 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:25.345000 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:25.355819 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:25.367137 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:25.378586 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:25.389977 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:25.509502 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:25.624660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:26.093858 run create_hlr_db(pid=13771): Launched 02:27:26.209645 bus /sierra_2: Setting Powered False 02:27:27.270094 run create_hlr_db(pid=13771): Terminated: ok {rc=0} 02:27:27.712228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13773): Launched 02:27:28.035362 run osmo-hlr_10.42.42.2(pid=13774): Launched 02:27:28.159490 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:28.720260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13776): Launched 02:27:29.044374 run osmo-stp_10.42.42.5(pid=13777): Launched 02:27:29.168297 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:29.752822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13779): Launched 02:27:30.075794 run osmo-msc_10.42.42.6(pid=13780): Launched 02:27:30.255902 run osmo-stp_10.42.42.5(pid=13777): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13777)] 02:27:30.391940 run osmo-stp_10.42.42.5(pid=13777): stdout: | (launched: 2022-12-10_02:27:28.985109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:30.530398 run osmo-stp_10.42.42.5(pid=13777): stderr: | [0;m[38;5;43m20221210022729180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022729180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022729181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022729181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022729181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022729182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022729182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:30.666524 run osmo-stp_10.42.42.5(pid=13777): stdout: | (launched: 2022-12-10_02:27:28.985109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:30.794933 run osmo-stp_10.42.42.5(pid=13777): stderr: | [0;m[38;5;43m20221210022729180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022729180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022729181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022729181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022729181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022729182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022729182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:30.971622 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13777): Process ended prematurely: osmo-stp_10.42.42.5(pid=13777) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13777)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:27:30.981706 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:27:31.010277 run osmo-hlr_10.42.42.2(pid=13774): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13774)] 02:27:31.065554 run osmo-hlr_10.42.42.2(pid=13774): stdout: | (launched: 2022-12-10_02:27:27.976651) 02:27:31.118219 run osmo-hlr_10.42.42.2(pid=13774): stderr: | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022728177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022728190 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022728198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022728198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022728199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:31.191068 run osmo-msc_10.42.42.6(pid=13780): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13780)] 02:27:31.242188 run osmo-msc_10.42.42.6(pid=13780): stdout: | (launched: 2022-12-10_02:27:30.017083) 02:27:31.294699 run osmo-msc_10.42.42.6(pid=13780): stderr: | [0;m[38;5;43m20221210022730338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022730338 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b2a718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022730338 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022730338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022730338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022730339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022730340 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022730341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022730341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022730341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:31.347738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13773): Terminating (SIGTERM) 02:27:31.390381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13776): Terminating (SIGTERM) 02:27:31.432756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13779): Terminating (SIGTERM) 02:27:31.475591 --- ParallelTerminationStrategy: PID 13773 died... 02:27:31.495752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13773): Terminated: ok {rc=0} 02:27:31.542585 --- ParallelTerminationStrategy: PID 13776 died... 02:27:31.562660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13776): Terminated: ok {rc=0} 02:27:31.609784 --- ParallelTerminationStrategy: PID 13779 died... 02:27:31.630273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13779): Terminated: ok {rc=0} 02:27:31.719702 bus /sierra_3: Setting Powered False 02:27:32.818171 bus /sierra_3: Setting Powered False 02:27:33.935567 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:27:35.086710 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.099041 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:27:35.175171 tst mo_mt_call_osmux.py: using LAC 25349 02:27:35.303352 tst mo_mt_call_osmux.py: using RAC 104 02:27:35.430486 tst mo_mt_call_osmux.py: using CellId 25349 02:27:35.556910 tst mo_mt_call_osmux.py: using BVCI 25350 02:27:35.676708 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.688239 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.699828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.711144 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.722632 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:35.733949 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:35.853782 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:35.974083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:36.444773 run create_hlr_db(pid=13784): Launched 02:27:36.561809 bus /sierra_2: Setting Powered False 02:27:37.622352 run create_hlr_db(pid=13784): Terminated: ok {rc=0} 02:27:38.044220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13786): Launched 02:27:38.347671 run osmo-hlr_10.42.42.2(pid=13787): Launched 02:27:38.464296 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:39.001360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13789): Launched 02:27:39.304903 run osmo-stp_10.42.42.5(pid=13790): Launched 02:27:39.421511 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:39.967881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13792): Launched 02:27:40.270450 run osmo-msc_10.42.42.6(pid=13793): Launched 02:27:40.440621 run osmo-stp_10.42.42.5(pid=13790): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13790)] 02:27:40.569522 run osmo-stp_10.42.42.5(pid=13790): stdout: | (launched: 2022-12-10_02:27:39.249568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:40.698296 run osmo-stp_10.42.42.5(pid=13790): stderr: | [0;m[38;5;43m20221210022739419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022739419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022739420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022739420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:40.824875 run osmo-stp_10.42.42.5(pid=13790): stdout: | (launched: 2022-12-10_02:27:39.249568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:40.944506 run osmo-stp_10.42.42.5(pid=13790): stderr: | [0;m[38;5;43m20221210022739419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022739419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022739420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022739420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022739421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:41.088119 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13790): Process ended prematurely: osmo-stp_10.42.42.5(pid=13790) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13790)] [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:27:41.097126 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:27:41.124004 run osmo-hlr_10.42.42.2(pid=13787): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13787)] 02:27:41.171881 run osmo-hlr_10.42.42.2(pid=13787): stdout: | (launched: 2022-12-10_02:27:38.292036) 02:27:41.221305 run osmo-hlr_10.42.42.2(pid=13787): stderr: | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022738467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022738479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022738488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022738488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022738488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:41.290378 run osmo-msc_10.42.42.6(pid=13793): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13793)] 02:27:41.337949 run osmo-msc_10.42.42.6(pid=13793): stdout: | (launched: 2022-12-10_02:27:40.215035) 02:27:41.387101 run osmo-msc_10.42.42.6(pid=13793): stderr: | [0;m[38;5;43m20221210022740485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022740485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f19cc87dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022740485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022740485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022740485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022740485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022740489 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022740489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022740489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022740489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:41.436581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13786): Terminating (SIGTERM) 02:27:41.476065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13789): Terminating (SIGTERM) 02:27:41.515496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13792): Terminating (SIGTERM) 02:27:41.555193 --- ParallelTerminationStrategy: PID 13786 died... 02:27:41.574198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13786): Terminated: ok {rc=0} 02:27:41.618316 --- ParallelTerminationStrategy: PID 13789 died... 02:27:41.636669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13789): Terminated: ok {rc=0} 02:27:41.680708 --- ParallelTerminationStrategy: PID 13792 died... 02:27:41.699227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13792): Terminated: ok {rc=0} 02:27:41.786318 bus /sierra_3: Setting Powered False 02:27:42.884185 bus /sierra_3: Setting Powered False 02:27:43.999404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:27:45.253542 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:45.260501 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:27:45.297814 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:27:45.325977 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:27:45.385959 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:27:45.422465 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:27:45.449865 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:27:46.019662 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:27:46.071219 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.083342 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:27:46.156695 tst mo_mt_call.py: using LAC 25350 02:27:46.279739 tst mo_mt_call.py: using RAC 105 02:27:46.411619 tst mo_mt_call.py: using CellId 25350 02:27:46.541125 tst mo_mt_call.py: using BVCI 25351 02:27:46.662088 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.674380 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.686929 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.699377 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.711986 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:46.725576 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:27:46.855084 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:27:46.995088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:47.539296 run create_hlr_db(pid=13798): Launched 02:27:47.671922 bus /sierra_2: Setting Powered False 02:27:48.736156 run create_hlr_db(pid=13798): Terminated: ok {rc=0} 02:27:49.166897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13800): Launched 02:27:49.469508 run osmo-hlr_10.42.42.2(pid=13801): Launched 02:27:49.586768 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:50.109363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13803): Launched 02:27:50.412032 run osmo-stp_10.42.42.5(pid=13804): Launched 02:27:50.527584 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:51.075543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13806): Launched 02:27:51.379486 run osmo-msc_10.42.42.6(pid=13807): Launched 02:27:51.550213 run osmo-stp_10.42.42.5(pid=13804): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13804)] 02:27:51.679788 run osmo-stp_10.42.42.5(pid=13804): stdout: | (launched: 2022-12-10_02:27:50.356726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:51.809119 run osmo-stp_10.42.42.5(pid=13804): stderr: | [0;m[38;5;43m20221210022750528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022750528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022750529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022750529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:51.936022 run osmo-stp_10.42.42.5(pid=13804): stdout: | (launched: 2022-12-10_02:27:50.356726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:52.056138 run osmo-stp_10.42.42.5(pid=13804): stderr: | [0;m[38;5;43m20221210022750528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022750528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022750529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022750529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022750530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:52.199770 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13804): Process ended prematurely: osmo-stp_10.42.42.5(pid=13804) [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13804)] [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:27:52.208699 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:27:52.235418 run osmo-hlr_10.42.42.2(pid=13801): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13801)] 02:27:52.283767 run osmo-hlr_10.42.42.2(pid=13801): stdout: | (launched: 2022-12-10_02:27:49.414193) 02:27:52.333623 run osmo-hlr_10.42.42.2(pid=13801): stderr: | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022749592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022749604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022749613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022749613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022749613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:52.403348 run osmo-msc_10.42.42.6(pid=13807): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13807)] 02:27:52.451412 run osmo-msc_10.42.42.6(pid=13807): stdout: | (launched: 2022-12-10_02:27:51.323999) 02:27:52.501117 run osmo-msc_10.42.42.6(pid=13807): stderr: | [0;m[38;5;43m20221210022751594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022751594 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fcffdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022751594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022751594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022751594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022751595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022751596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022751597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022751597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022751597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:52.551143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13800): Terminating (SIGTERM) 02:27:52.590936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13803): Terminating (SIGTERM) 02:27:52.630591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13806): Terminating (SIGTERM) 02:27:52.670748 --- ParallelTerminationStrategy: PID 13800 died... 02:27:52.689884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13800): Terminated: ok {rc=0} 02:27:52.734297 --- ParallelTerminationStrategy: PID 13803 died... 02:27:52.753076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13803): Terminated: ok {rc=0} 02:27:52.797685 --- ParallelTerminationStrategy: PID 13806 died... 02:27:52.816586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13806): Terminated: ok {rc=0} 02:27:52.900837 bus /sierra_3: Setting Powered False 02:27:53.996137 bus /sierra_3: Setting Powered False 02:27:55.111922 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:27:56.258776 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.270666 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:27:56.341267 tst mo_mt_call_osmux.py: using LAC 25351 02:27:56.459434 tst mo_mt_call_osmux.py: using RAC 106 02:27:56.579632 tst mo_mt_call_osmux.py: using CellId 25351 02:27:56.699478 tst mo_mt_call_osmux.py: using BVCI 25352 02:27:56.808774 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.819996 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.830956 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.842036 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.853311 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:27:56.864405 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:27:56.983244 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:27:57.102856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:57.606006 run create_hlr_db(pid=13809): Launched 02:27:57.739636 bus /sierra_2: Setting Powered False 02:27:58.803015 run create_hlr_db(pid=13809): Terminated: ok {rc=0} 02:27:59.234412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13811): Launched 02:27:59.539230 run osmo-hlr_10.42.42.2(pid=13812): Launched 02:27:59.655243 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:00.190672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13814): Launched 02:28:00.493998 run osmo-stp_10.42.42.5(pid=13815): Launched 02:28:00.609915 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:01.205932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13817): Launched 02:28:01.522413 run osmo-msc_10.42.42.6(pid=13818): Launched 02:28:01.825332 run osmo-stp_10.42.42.5(pid=13815): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13815)] 02:28:02.033536 run osmo-stp_10.42.42.5(pid=13815): stdout: | (launched: 2022-12-10_02:28:00.438630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:02.299015 run osmo-stp_10.42.42.5(pid=13815): stderr: | [0;m[38;5;43m20221210022800610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022800610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022800611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022800611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022800611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022800612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022800612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:02.429389 run osmo-stp_10.42.42.5(pid=13815): stdout: | (launched: 2022-12-10_02:28:00.438630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:02.549649 run osmo-stp_10.42.42.5(pid=13815): stderr: | [0;m[38;5;43m20221210022800610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022800610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022800611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022800611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022800611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022800612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022800612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:02.694253 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13815): Process ended prematurely: osmo-stp_10.42.42.5(pid=13815) [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13815)] [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:28:02.703204 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:28:02.730057 run osmo-hlr_10.42.42.2(pid=13812): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13812)] 02:28:02.777956 run osmo-hlr_10.42.42.2(pid=13812): stdout: | (launched: 2022-12-10_02:27:59.484008) 02:28:02.827465 run osmo-hlr_10.42.42.2(pid=13812): stderr: | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022759661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022759672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022759682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022759682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022759682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:02.896414 run osmo-msc_10.42.42.6(pid=13818): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13818)] 02:28:02.944086 run osmo-msc_10.42.42.6(pid=13818): stdout: | (launched: 2022-12-10_02:28:01.462556) 02:28:02.993367 run osmo-msc_10.42.42.6(pid=13818): stderr: | [0;m[38;5;43m20221210022802103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022802104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3204db1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022802105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022802106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022802106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022802107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022802114 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022802116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022802117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022802117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:03.042947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13811): Terminating (SIGTERM) 02:28:03.082661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13814): Terminating (SIGTERM) 02:28:03.122674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13817): Terminating (SIGTERM) 02:28:03.162840 --- ParallelTerminationStrategy: PID 13811 died... 02:28:03.182084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13811): Terminated: ok {rc=0} 02:28:03.226745 --- ParallelTerminationStrategy: PID 13814 died... 02:28:03.245618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13814): Terminated: ok {rc=0} 02:28:03.290423 --- ParallelTerminationStrategy: PID 13817 died... 02:28:03.309330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13817): Terminated: ok {rc=0} 02:28:03.396134 bus /sierra_3: Setting Powered False 02:28:04.495880 bus /sierra_3: Setting Powered False 02:28:05.612328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:28:06.859432 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:06.865115 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:28:06.900137 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:28:06.926994 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:28:06.978245 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:28:07.012324 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:28:07.039762 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:28:07.590244 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:28:07.642892 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:07.654381 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:28:07.724740 tst mo_mt_call.py: using LAC 25352 02:28:07.850827 tst mo_mt_call.py: using RAC 107 02:28:07.976294 tst mo_mt_call.py: using CellId 25352 02:28:08.102406 tst mo_mt_call.py: using BVCI 25353 02:28:08.219982 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:08.231236 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:08.242525 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:08.253842 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:08.265188 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:08.276288 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:08.392897 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:08.511373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:09.017180 run create_hlr_db(pid=13823): Launched 02:28:09.149987 bus /sierra_2: Setting Powered False 02:28:10.214421 run create_hlr_db(pid=13823): Terminated: ok {rc=0} 02:28:10.647315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Launched 02:28:10.952335 run osmo-hlr_10.42.42.2(pid=13827): Launched 02:28:11.068389 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:11.606791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Launched 02:28:11.910437 run osmo-stp_10.42.42.5(pid=13830): Launched 02:28:12.026622 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:12.591835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Launched 02:28:12.895377 run osmo-msc_10.42.42.6(pid=13833): Launched 02:28:13.065904 run osmo-stp_10.42.42.5(pid=13830): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] 02:28:13.194977 run osmo-stp_10.42.42.5(pid=13830): stdout: | (launched: 2022-12-10_02:28:11.854983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:13.324548 run osmo-stp_10.42.42.5(pid=13830): stderr: | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022812025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:13.451923 run osmo-stp_10.42.42.5(pid=13830): stdout: | (launched: 2022-12-10_02:28:11.854983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:13.572592 run osmo-stp_10.42.42.5(pid=13830): stderr: | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022812024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022812025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022812025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:13.717125 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13830): Process ended prematurely: osmo-stp_10.42.42.5(pid=13830) [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:28:13.726135 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:28:13.753247 run osmo-hlr_10.42.42.2(pid=13827): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13827)] 02:28:13.802244 run osmo-hlr_10.42.42.2(pid=13827): stdout: | (launched: 2022-12-10_02:28:10.896646) 02:28:13.852361 run osmo-hlr_10.42.42.2(pid=13827): stderr: | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022811071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022811083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022811093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022811093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022811093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:13.922245 run osmo-msc_10.42.42.6(pid=13833): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13833)] 02:28:13.970717 run osmo-msc_10.42.42.6(pid=13833): stdout: | (launched: 2022-12-10_02:28:12.840199) 02:28:14.020662 run osmo-msc_10.42.42.6(pid=13833): stderr: | [0;m[38;5;43m20221210022813111 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022813111 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4bae30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022813112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022813112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022813112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022813112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022813114 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022813115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022813115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022813115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:14.071027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Terminating (SIGTERM) 02:28:14.111657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Terminating (SIGTERM) 02:28:14.152087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Terminating (SIGTERM) 02:28:14.192725 --- ParallelTerminationStrategy: PID 13826 died... 02:28:14.212040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Terminated: ok {rc=0} 02:28:14.257442 --- ParallelTerminationStrategy: PID 13829 died... 02:28:14.276084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Terminated: ok {rc=0} 02:28:14.321188 --- ParallelTerminationStrategy: PID 13832 died... 02:28:14.339839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Terminated: ok {rc=0} 02:28:14.427157 bus /sierra_3: Setting Powered False 02:28:15.526572 bus /sierra_3: Setting Powered False 02:28:16.650454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:28:17.813685 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:17.825803 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:28:17.901480 tst mo_mt_call_osmux.py: using LAC 25353 02:28:18.032044 tst mo_mt_call_osmux.py: using RAC 108 02:28:18.151923 tst mo_mt_call_osmux.py: using CellId 25353 02:28:18.270468 tst mo_mt_call_osmux.py: using BVCI 25354 02:28:18.382912 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:18.394272 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:18.405415 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:18.416430 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:18.428414 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:18.439114 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:18.554525 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:18.674759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:19.146499 run create_hlr_db(pid=13835): Launched 02:28:19.262808 bus /sierra_2: Setting Powered False 02:28:20.323278 run create_hlr_db(pid=13835): Terminated: ok {rc=0} 02:28:20.745410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13837): Launched 02:28:21.049522 run osmo-hlr_10.42.42.2(pid=13838): Launched 02:28:21.166439 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:21.690388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13840): Launched 02:28:21.994239 run osmo-stp_10.42.42.5(pid=13841): Launched 02:28:22.111448 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:22.659711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13843): Launched 02:28:22.963040 run osmo-msc_10.42.42.6(pid=13844): Launched 02:28:23.133866 run osmo-stp_10.42.42.5(pid=13841): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13841)] 02:28:23.262573 run osmo-stp_10.42.42.5(pid=13841): stdout: | (launched: 2022-12-10_02:28:21.938886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:23.391601 run osmo-stp_10.42.42.5(pid=13841): stderr: | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022822110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:23.519701 run osmo-stp_10.42.42.5(pid=13841): stdout: | (launched: 2022-12-10_02:28:21.938886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:23.639931 run osmo-stp_10.42.42.5(pid=13841): stderr: | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022822109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022822110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022822110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:23.784207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13841): Process ended prematurely: osmo-stp_10.42.42.5(pid=13841) [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13841)] [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:28:23.793244 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:28:23.820118 run osmo-hlr_10.42.42.2(pid=13838): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13838)] 02:28:23.868132 run osmo-hlr_10.42.42.2(pid=13838): stdout: | (launched: 2022-12-10_02:28:20.993911) 02:28:23.917876 run osmo-hlr_10.42.42.2(pid=13838): stderr: | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022821169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022821182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022821190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022821190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022821190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:23.987057 run osmo-msc_10.42.42.6(pid=13844): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13844)] 02:28:24.035260 run osmo-msc_10.42.42.6(pid=13844): stdout: | (launched: 2022-12-10_02:28:22.907810) 02:28:24.085568 run osmo-msc_10.42.42.6(pid=13844): stderr: | [0;m[38;5;43m20221210022823178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022823178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3cffb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022823178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022823178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022823178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022823178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022823180 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022823180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022823181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022823181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:24.136214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13837): Terminating (SIGTERM) 02:28:24.175997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13840): Terminating (SIGTERM) 02:28:24.215669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13843): Terminating (SIGTERM) 02:28:24.255998 --- ParallelTerminationStrategy: PID 13837 died... 02:28:24.275226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13837): Terminated: ok {rc=0} 02:28:24.319789 --- ParallelTerminationStrategy: PID 13840 died... 02:28:24.338451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13840): Terminated: ok {rc=0} 02:28:24.383103 --- ParallelTerminationStrategy: PID 13843 died... 02:28:24.402017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13843): Terminated: ok {rc=0} 02:28:24.488679 bus /sierra_3: Setting Powered False 02:28:25.588359 bus /sierra_3: Setting Powered False 02:28:26.705173 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 02:28:27.957104 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:27.962022 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 02:28:27.995796 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 02:28:28.022150 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 02:28:28.075008 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 02:28:28.107856 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 02:28:28.133862 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 02:28:28.681868 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 02:28:28.731055 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:28.742092 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:28:28.792058 tst mo_mt_call.py: using LAC 25354 02:28:28.912115 tst mo_mt_call.py: using RAC 109 02:28:29.032834 tst mo_mt_call.py: using CellId 25354 02:28:29.160851 tst mo_mt_call.py: using BVCI 25355 02:28:29.278604 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:29.290188 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:29.301605 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:29.312886 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:29.324299 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:29.335684 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:29.451749 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:29.567470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:30.072725 run create_hlr_db(pid=13850): Launched 02:28:30.205080 bus /sierra_2: Setting Powered False 02:28:31.288497 run create_hlr_db(pid=13850): Terminated: ok {rc=0} 02:28:31.771199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Launched 02:28:32.115518 run osmo-hlr_10.42.42.2(pid=13853): Launched 02:28:32.364279 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:32.925843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Launched 02:28:33.251552 run osmo-stp_10.42.42.5(pid=13856): Launched 02:28:33.376133 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:33.964177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13858): Launched 02:28:34.289471 run osmo-msc_10.42.42.6(pid=13859): Launched 02:28:34.471723 run osmo-stp_10.42.42.5(pid=13856): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] 02:28:34.608586 run osmo-stp_10.42.42.5(pid=13856): stdout: | (launched: 2022-12-10_02:28:33.192603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:34.746834 run osmo-stp_10.42.42.5(pid=13856): stderr: | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022833387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:34.883740 run osmo-stp_10.42.42.5(pid=13856): stdout: | (launched: 2022-12-10_02:28:33.192603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:35.012674 run osmo-stp_10.42.42.5(pid=13856): stderr: | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022833386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022833387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022833387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:35.167902 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13856): Process ended prematurely: osmo-stp_10.42.42.5(pid=13856) [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 02:28:35.177596 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:28:35.205547 run osmo-hlr_10.42.42.2(pid=13853): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13853)] 02:28:35.255683 run osmo-hlr_10.42.42.2(pid=13853): stdout: | (launched: 2022-12-10_02:28:32.051487) 02:28:35.307968 run osmo-hlr_10.42.42.2(pid=13853): stderr: | [0;m[1;31m20221210022832340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022832340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022832340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022832340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022832341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022832341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022832359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022832367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022832367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022832367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:35.380305 run osmo-msc_10.42.42.6(pid=13859): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13859)] 02:28:35.430437 run osmo-msc_10.42.42.6(pid=13859): stdout: | (launched: 2022-12-10_02:28:34.230278) 02:28:35.481981 run osmo-msc_10.42.42.6(pid=13859): stderr: | [0;m[38;5;43m20221210022834554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022834554 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc37ebc1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022834555 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022834555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022834555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022834555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022834557 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022834557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022834557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022834558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:35.534086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Terminating (SIGTERM) 02:28:35.576105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Terminating (SIGTERM) 02:28:35.617943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13858): Terminating (SIGTERM) 02:28:35.661054 --- ParallelTerminationStrategy: PID 13852 died... 02:28:35.681253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13852): Terminated: ok {rc=0} 02:28:35.728273 --- ParallelTerminationStrategy: PID 13855 died... 02:28:35.748022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13855): Terminated: ok {rc=0} 02:28:35.794695 --- ParallelTerminationStrategy: PID 13858 died... 02:28:35.814552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13858): Terminated: ok {rc=0} 02:28:35.903171 bus /sierra_3: Setting Powered False 02:28:37.001962 bus /sierra_3: Setting Powered False 02:28:38.117830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 02:28:39.260515 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.271892 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:28:39.325442 tst mo_mt_call_osmux.py: using LAC 25355 02:28:39.444127 tst mo_mt_call_osmux.py: using RAC 110 02:28:39.561281 tst mo_mt_call_osmux.py: using CellId 25355 02:28:39.678881 tst mo_mt_call_osmux.py: using BVCI 25356 02:28:39.788366 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.799328 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.810074 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.821067 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.832036 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:39.842929 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:39.960888 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:40.079334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:40.550139 run create_hlr_db(pid=13861): Launched 02:28:40.665844 bus /sierra_2: Setting Powered False 02:28:41.725943 run create_hlr_db(pid=13861): Terminated: ok {rc=0} 02:28:42.169600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13863): Launched 02:28:42.496035 run osmo-hlr_10.42.42.2(pid=13864): Launched 02:28:42.620927 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:43.182917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13866): Launched 02:28:43.507754 run osmo-stp_10.42.42.5(pid=13867): Launched 02:28:43.633389 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:44.219587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Launched 02:28:44.543775 run osmo-msc_10.42.42.6(pid=13870): Launched 02:28:44.725982 run osmo-stp_10.42.42.5(pid=13867): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13867)] 02:28:44.862774 run osmo-stp_10.42.42.5(pid=13867): stdout: | (launched: 2022-12-10_02:28:43.449236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:44.999730 run osmo-stp_10.42.42.5(pid=13867): stderr: | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022843640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:45.136083 run osmo-stp_10.42.42.5(pid=13867): stdout: | (launched: 2022-12-10_02:28:43.449236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:45.264839 run osmo-stp_10.42.42.5(pid=13867): stderr: | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022843639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022843640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022843640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:45.419115 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13867): Process ended prematurely: osmo-stp_10.42.42.5(pid=13867) [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13867)] [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 02:28:45.428507 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:28:45.456227 run osmo-hlr_10.42.42.2(pid=13864): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13864)] 02:28:45.506759 run osmo-hlr_10.42.42.2(pid=13864): stdout: | (launched: 2022-12-10_02:28:42.437374) 02:28:45.558471 run osmo-hlr_10.42.42.2(pid=13864): stderr: | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022842635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022842648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022842657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022842657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022842657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:45.630743 run osmo-msc_10.42.42.6(pid=13870): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13870)] 02:28:45.681274 run osmo-msc_10.42.42.6(pid=13870): stdout: | (launched: 2022-12-10_02:28:44.484649) 02:28:45.732565 run osmo-msc_10.42.42.6(pid=13870): stderr: | [0;m[38;5;43m20221210022844806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022844806 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa5cde6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022844806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022844806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022844806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022844806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022844808 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022844808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022844809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022844809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:45.784256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13863): Terminating (SIGTERM) 02:28:45.825722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13866): Terminating (SIGTERM) 02:28:45.896072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Terminating (SIGTERM) 02:28:45.953377 --- ParallelTerminationStrategy: PID 13863 died... 02:28:45.973670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13863): Terminated: ok {rc=0} 02:28:46.022905 --- ParallelTerminationStrategy: PID 13866 died... 02:28:46.042698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13866): Terminated: ok {rc=0} 02:28:46.090275 --- ParallelTerminationStrategy: PID 13869 died... 02:28:46.110953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Terminated: ok {rc=0} 02:28:46.199599 bus /sierra_3: Setting Powered False 02:28:47.298119 bus /sierra_3: Setting Powered False 02:28:48.412692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:28:49.663735 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:49.670358 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:28:49.704586 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:28:49.732030 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:28:49.786453 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:28:49.820587 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:28:49.847931 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:28:50.399949 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:28:50.451547 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:50.463247 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:28:50.516770 tst mo_mt_call.py: using LAC 25356 02:28:50.644118 tst mo_mt_call.py: using RAC 111 02:28:50.772068 tst mo_mt_call.py: using CellId 25356 02:28:50.898251 tst mo_mt_call.py: using BVCI 25357 02:28:51.009881 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:51.021521 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:51.032560 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:51.043968 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:51.055431 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:28:51.066870 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:28:51.188726 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:28:51.309273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:51.814862 run create_hlr_db(pid=13876): Launched 02:28:51.947499 bus /sierra_2: Setting Powered False 02:28:53.011482 run create_hlr_db(pid=13876): Terminated: ok {rc=0} 02:28:53.444872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Launched 02:28:53.750263 run osmo-hlr_10.42.42.2(pid=13879): Launched 02:28:53.867202 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:54.399393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Launched 02:28:54.702899 run osmo-stp_10.42.42.5(pid=13882): Launched 02:28:54.819069 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:55.365240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Launched 02:28:55.669052 run osmo-msc_10.42.42.6(pid=13885): Launched 02:28:55.840150 run osmo-stp_10.42.42.5(pid=13882): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] 02:28:55.969965 run osmo-stp_10.42.42.5(pid=13882): stdout: | (launched: 2022-12-10_02:28:54.646981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:56.099180 run osmo-stp_10.42.42.5(pid=13882): stderr: | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022854815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:56.226604 run osmo-stp_10.42.42.5(pid=13882): stdout: | (launched: 2022-12-10_02:28:54.646981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:56.346864 run osmo-stp_10.42.42.5(pid=13882): stderr: | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022854815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022854815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022854818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:56.491688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13882): Process ended prematurely: osmo-stp_10.42.42.5(pid=13882) [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:28:56.500633 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:28:56.527617 run osmo-hlr_10.42.42.2(pid=13879): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13879)] 02:28:56.575334 run osmo-hlr_10.42.42.2(pid=13879): stdout: | (launched: 2022-12-10_02:28:53.694523) 02:28:56.624733 run osmo-hlr_10.42.42.2(pid=13879): stderr: | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022853870 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022853882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022853892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022853892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022853892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:56.693420 run osmo-msc_10.42.42.6(pid=13885): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13885)] 02:28:56.741015 run osmo-msc_10.42.42.6(pid=13885): stdout: | (launched: 2022-12-10_02:28:55.612932) 02:28:56.790215 run osmo-msc_10.42.42.6(pid=13885): stderr: | [0;m[38;5;43m20221210022855888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022855888 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f965712bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022855888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022855888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022855889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022855889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022855891 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022855891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022855892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022855892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:56.840091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Terminating (SIGTERM) 02:28:56.880075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Terminating (SIGTERM) 02:28:56.920142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Terminating (SIGTERM) 02:28:56.960198 --- ParallelTerminationStrategy: PID 13878 died... 02:28:56.979304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Terminated: ok {rc=0} 02:28:57.024092 --- ParallelTerminationStrategy: PID 13881 died... 02:28:57.042716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Terminated: ok {rc=0} 02:28:57.086772 --- ParallelTerminationStrategy: PID 13884 died... 02:28:57.105477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Terminated: ok {rc=0} 02:28:57.189499 bus /sierra_3: Setting Powered False 02:28:58.288211 bus /sierra_3: Setting Powered False 02:28:59.406294 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:29:00.551275 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:00.563136 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:29:00.615019 tst mo_mt_call_osmux.py: using LAC 25357 02:29:00.734642 tst mo_mt_call_osmux.py: using RAC 112 02:29:00.871817 tst mo_mt_call_osmux.py: using CellId 25357 02:29:01.006052 tst mo_mt_call_osmux.py: using BVCI 25358 02:29:01.131675 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:01.144353 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:01.157086 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:01.170439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:01.182750 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:01.195360 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:01.317901 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:01.438607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:01.929923 run create_hlr_db(pid=13887): Launched 02:29:02.110682 bus /sierra_2: Setting Powered False 02:29:03.170535 run create_hlr_db(pid=13887): Terminated: ok {rc=0} 02:29:03.592139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Launched 02:29:03.895534 run osmo-hlr_10.42.42.2(pid=13890): Launched 02:29:04.010620 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:04.528698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Launched 02:29:04.831024 run osmo-stp_10.42.42.5(pid=13893): Launched 02:29:04.946554 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:05.490594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Launched 02:29:05.794209 run osmo-msc_10.42.42.6(pid=13896): Launched 02:29:05.963416 run osmo-stp_10.42.42.5(pid=13893): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] 02:29:06.092045 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-10_02:29:04.775658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:06.220779 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221210022904946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022904946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022904947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022904947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:06.346961 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-10_02:29:04.775658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:06.467048 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221210022904946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022904946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022904947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022904947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022904948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:06.610595 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:29:06.619336 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:29:06.645967 run osmo-hlr_10.42.42.2(pid=13890): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13890)] 02:29:06.693458 run osmo-hlr_10.42.42.2(pid=13890): stdout: | (launched: 2022-12-10_02:29:03.840374) 02:29:06.742867 run osmo-hlr_10.42.42.2(pid=13890): stderr: | [0;m[1;31m20221210022904016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022904016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022904016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022904016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022904016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022904017 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022904032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022904042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022904042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022904042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:06.811660 run osmo-msc_10.42.42.6(pid=13896): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13896)] 02:29:06.859866 run osmo-msc_10.42.42.6(pid=13896): stdout: | (launched: 2022-12-10_02:29:05.738297) 02:29:06.909237 run osmo-msc_10.42.42.6(pid=13896): stderr: | [0;m[38;5;43m20221210022906011 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022906011 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c9d43bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022906012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022906012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022906012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022906012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022906014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022906015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022906015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022906015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:06.958727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminating (SIGTERM) 02:29:06.998567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminating (SIGTERM) 02:29:07.038629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminating (SIGTERM) 02:29:07.078938 --- ParallelTerminationStrategy: PID 13889 died... 02:29:07.098101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminated: ok {rc=0} 02:29:07.142629 --- ParallelTerminationStrategy: PID 13892 died... 02:29:07.161312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminated: ok {rc=0} 02:29:07.205811 --- ParallelTerminationStrategy: PID 13895 died... 02:29:07.224477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminated: ok {rc=0} 02:29:07.309311 bus /sierra_3: Setting Powered False 02:29:08.405840 bus /sierra_3: Setting Powered False 02:29:09.522090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:trx-b200 --------------------------------------------------------------------- 02:29:10.772389 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:10.776545 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 02:29:10.809309 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:29:10.835749 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 02:29:10.920551 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 02:29:10.953748 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:29:10.980314 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 02:29:11.563344 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 02:29:11.568227 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:11.578819 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:29:11.632703 tst emergency_mo_mt_call.py: using LAC 25358 02:29:11.759632 tst emergency_mo_mt_call.py: using RAC 113 02:29:11.885287 tst emergency_mo_mt_call.py: using CellId 25358 02:29:12.008477 tst emergency_mo_mt_call.py: using BVCI 25359 02:29:12.124024 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:12.135345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:12.146298 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:12.157173 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:12.168032 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:12.178857 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:12.293997 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:12.412657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:12.908149 run create_hlr_db(pid=13903): Launched 02:29:13.037938 bus /sierra_2: Setting Powered False 02:29:14.100742 run create_hlr_db(pid=13903): Terminated: ok {rc=0} 02:29:14.545609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13905): Launched 02:29:14.864583 run osmo-hlr_10.42.42.2(pid=13906): Launched 02:29:14.985618 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:15.533632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13908): Launched 02:29:15.865733 run osmo-stp_10.42.42.5(pid=13909): Launched 02:29:16.117545 tst emergency_mo_mt_call.py: using MSISDN 7506 02:29:16.337321 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:16.897313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13911): Launched 02:29:17.215842 run osmo-msc_10.42.42.6(pid=13912): Launched 02:29:17.418957 run osmo-stp_10.42.42.5(pid=13909): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13909)] 02:29:17.548240 run osmo-stp_10.42.42.5(pid=13909): stdout: | (launched: 2022-12-10_02:29:15.795011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:17.677314 run osmo-stp_10.42.42.5(pid=13909): stderr: | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022916069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:17.802532 run osmo-stp_10.42.42.5(pid=13909): stdout: | (launched: 2022-12-10_02:29:15.795011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:17.922077 run osmo-stp_10.42.42.5(pid=13909): stderr: | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022916069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022916069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022916070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:18.063784 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13909): Process ended prematurely: osmo-stp_10.42.42.5(pid=13909) [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13909)] [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 02:29:18.072297 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 02:29:18.098766 run osmo-hlr_10.42.42.2(pid=13906): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13906)] 02:29:18.147119 run osmo-hlr_10.42.42.2(pid=13906): stdout: | (launched: 2022-12-10_02:29:14.806681) 02:29:18.197397 run osmo-hlr_10.42.42.2(pid=13906): stderr: | [0;m[1;31m20221210022915006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022915006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022915006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022915007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022915007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022915007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022915019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022915027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022915027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022915028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:18.266767 run osmo-msc_10.42.42.6(pid=13912): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13912)] 02:29:18.314664 run osmo-msc_10.42.42.6(pid=13912): stdout: | (launched: 2022-12-10_02:29:17.156847) 02:29:18.364308 run osmo-msc_10.42.42.6(pid=13912): stderr: | [0;m[38;5;43m20221210022917473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022917474 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8835a2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022917474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022917474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022917474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022917474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022917476 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022917476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022917477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022917477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:18.414536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13905): Terminating (SIGTERM) 02:29:18.454596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13908): Terminating (SIGTERM) 02:29:18.494709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13911): Terminating (SIGTERM) 02:29:18.535145 --- ParallelTerminationStrategy: PID 13905 died... 02:29:18.554405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13905): Terminated: ok {rc=0} 02:29:18.599108 --- ParallelTerminationStrategy: PID 13908 died... 02:29:18.617884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13908): Terminated: ok {rc=0} 02:29:18.663221 --- ParallelTerminationStrategy: PID 13911 died... 02:29:18.681938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13911): Terminated: ok {rc=0} 02:29:18.768028 bus /sierra_3: Setting Powered False 02:29:19.866908 bus /sierra_3: Setting Powered False 02:29:20.983354 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 02:29:22.071088 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.082999 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:29:22.135222 tst emergency_preemptive_call.py: using LAC 25359 02:29:22.260284 tst emergency_preemptive_call.py: using RAC 114 02:29:22.385317 tst emergency_preemptive_call.py: using CellId 25359 02:29:22.511137 tst emergency_preemptive_call.py: using BVCI 25360 02:29:22.626015 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.637314 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.648122 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.659034 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.670449 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:22.681700 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:22.800595 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:22.916906 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:23.030709 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:23.149108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:23.642703 run create_hlr_db(pid=13914): Launched 02:29:23.772341 bus /sierra_2: Setting Powered False 02:29:24.836061 run create_hlr_db(pid=13914): Terminated: ok {rc=0} 02:29:25.280835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Launched 02:29:25.599225 run osmo-hlr_10.42.42.2(pid=13917): Launched 02:29:25.720485 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:26.272178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Launched 02:29:26.590245 run osmo-stp_10.42.42.5(pid=13920): Launched 02:29:26.720802 tst emergency_preemptive_call.py: using MSISDN 7507 02:29:26.884067 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:27.455346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13922): Launched 02:29:27.773563 run osmo-msc_10.42.42.6(pid=13923): Launched 02:29:27.952403 run osmo-stp_10.42.42.5(pid=13920): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] 02:29:28.088114 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-10_02:29:26.532506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:28.223976 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022926725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:28.359421 run osmo-stp_10.42.42.5(pid=13920): stdout: | (launched: 2022-12-10_02:29:26.532506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:28.486501 run osmo-stp_10.42.42.5(pid=13920): stderr: | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022926724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022926725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022926727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:28.638335 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py:32] 02:29:28.646960 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 02:29:28.674492 run osmo-hlr_10.42.42.2(pid=13917): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13917)] 02:29:28.725188 run osmo-hlr_10.42.42.2(pid=13917): stdout: | (launched: 2022-12-10_02:29:25.541335) 02:29:28.777312 run osmo-hlr_10.42.42.2(pid=13917): stderr: | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022925741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022925754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022925763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022925763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022925763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:28.850048 run osmo-msc_10.42.42.6(pid=13923): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13923)] 02:29:28.900196 run osmo-msc_10.42.42.6(pid=13923): stdout: | (launched: 2022-12-10_02:29:27.715579) 02:29:28.952043 run osmo-msc_10.42.42.6(pid=13923): stderr: | [0;m[38;5;43m20221210022928035 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210022928035 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f35cf413c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210022928035 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210022928035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210022928036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210022928036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210022928038 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210022928038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210022928038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210022928038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:29.004061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminating (SIGTERM) 02:29:29.045620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminating (SIGTERM) 02:29:29.087209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13922): Terminating (SIGTERM) 02:29:29.129132 --- ParallelTerminationStrategy: PID 13916 died... 02:29:29.148815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13916): Terminated: ok {rc=0} 02:29:29.195159 --- ParallelTerminationStrategy: PID 13919 died... 02:29:29.214692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13919): Terminated: ok {rc=0} 02:29:29.260302 --- ParallelTerminationStrategy: PID 13922 died... 02:29:29.279708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13922): Terminated: ok {rc=0} 02:29:29.366303 bus /sierra_9: Setting Powered False 02:29:30.464662 bus /sierra_9: Setting Powered False 02:29:31.590830 bus /sierra_8: Setting Powered False 02:29:32.703165 bus /sierra_8: Setting Powered False 02:29:33.818683 bus /sierra_3: Setting Powered False 02:29:34.918440 bus /sierra_3: Setting Powered False 02:29:36.034798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-b200 --------------------------------------------------------------------- 02:29:37.314857 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:37.319206 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 02:29:37.352777 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 02:29:37.391146 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 02:29:37.477871 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 02:29:37.510589 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 02:29:37.548630 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 02:29:38.137628 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 02:29:38.188281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.198927 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:29:38.247757 tst cs_paging_gprs_active.py: using LAC 25360 02:29:38.370163 tst cs_paging_gprs_active.py: using RAC 115 02:29:38.489104 tst cs_paging_gprs_active.py: using CellId 25360 02:29:38.609401 tst cs_paging_gprs_active.py: using BVCI 25361 02:29:38.722396 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.732837 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.743279 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.753918 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.764344 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.774839 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.785641 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.796176 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:38.806895 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:29:38.928292 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:29:39.045370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:29:39.250187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:29:39.554675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Launched 02:29:39.819283 run iperf3-srv_10.42.42.10(pid=13929): Launched 02:29:39.934435 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:29:40.139111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:29:40.444089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Launched 02:29:40.709639 run iperf3-srv_10.42.42.10(pid=13931): Launched 02:29:40.825609 tst cs_paging_gprs_active.py:38: start network... 02:29:41.029724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:41.503045 run create_hlr_db(pid=13932): Launched 02:29:41.620431 bus /sierra_2: Setting Powered False 02:29:42.681618 run create_hlr_db(pid=13932): Terminated: ok {rc=0} 02:29:43.125989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Launched 02:29:43.452802 run osmo-hlr_10.42.42.2(pid=13935): Launched 02:29:43.579216 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:44.144877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Launched 02:29:44.470624 run osmo-stp_10.42.42.5(pid=13938): Launched 02:29:44.596510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:29:45.159491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Launched 02:29:45.285118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:29:45.561133 run patchelf(pid=13941): Launched 02:29:45.743395 run osmo-stp_10.42.42.5(pid=13938): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] 02:29:45.896521 run osmo-stp_10.42.42.5(pid=13938): stdout: | (launched: 2022-12-10_02:29:44.411589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:46.051788 run osmo-stp_10.42.42.5(pid=13938): stderr: | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022944604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:46.195286 run osmo-stp_10.42.42.5(pid=13938): stdout: | (launched: 2022-12-10_02:29:44.411589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:46.333035 run osmo-stp_10.42.42.5(pid=13938): stderr: | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022944603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022944604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022944604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:46.495425 run patchelf(pid=13941): Terminating (SIGINT) 02:29:46.682389 run patchelf(pid=13941): Terminated: ok {rc=0} 02:29:46.817443 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13938): Process ended prematurely: osmo-stp_10.42.42.5(pid=13938) [trial-2368↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] [trial-2368↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 02:29:46.828119 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:29:46.858240 run osmo-hlr_10.42.42.2(pid=13935): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13935)] 02:29:46.910279 run osmo-hlr_10.42.42.2(pid=13935): stdout: | (launched: 2022-12-10_02:29:43.393730) 02:29:46.963583 run osmo-hlr_10.42.42.2(pid=13935): stderr: | [0;m[1;31m20221210022943594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022943595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022943595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022943595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022943595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022943595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022943606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022943615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022943615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022943615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:47.017767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminating (SIGTERM) 02:29:47.061651 run iperf3-srv_10.42.42.10(pid=13929): Terminating (SIGTERM) 02:29:47.107611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminating (SIGTERM) 02:29:47.151592 run iperf3-srv_10.42.42.10(pid=13931): Terminating (SIGTERM) 02:29:47.194081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Terminating (SIGTERM) 02:29:47.236227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Terminating (SIGTERM) 02:29:47.278216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Terminating (SIGTERM) 02:29:47.320704 --- ParallelTerminationStrategy: PID 13928 died... 02:29:47.341002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13928): Terminated: ok {rc=0} 02:29:47.387690 --- ParallelTerminationStrategy: PID 13929 died... 02:29:47.407426 run iperf3-srv_10.42.42.10(pid=13929): Terminated {rc=256} 02:29:47.453696 --- ParallelTerminationStrategy: PID 13930 died... 02:29:47.473475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13930): Terminated: ok {rc=0} 02:29:47.519936 --- ParallelTerminationStrategy: PID 13931 died... 02:29:47.539744 run iperf3-srv_10.42.42.10(pid=13931): Terminated {rc=256} 02:29:47.586716 --- ParallelTerminationStrategy: PID 13934 died... 02:29:47.606653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13934): Terminated: ok {rc=0} 02:29:47.653095 --- ParallelTerminationStrategy: PID 13937 died... 02:29:47.672851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13937): Terminated: ok {rc=0} 02:29:47.719833 --- ParallelTerminationStrategy: PID 13940 died... 02:29:47.739748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13940): Terminated: ok {rc=0} 02:29:47.829718 bus /gobi_0: Setting Powered False 02:29:48.930358 bus /gobi_0: Setting Powered False 02:29:50.049262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200 iperf3.py ---------------------------------------------- 02:29:51.201282 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.212914 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:29:51.268030 tst iperf3.py: using LAC 25361 02:29:51.397660 tst iperf3.py: using RAC 116 02:29:51.525391 tst iperf3.py: using CellId 25361 02:29:51.658268 tst iperf3.py: using BVCI 25362 02:29:51.779190 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.790343 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.801158 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.811839 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.822632 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.833389 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.844305 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.855107 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:51.866037 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:29:51.980676 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:29:52.186598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:29:52.492834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13942): Launched 02:29:52.759072 run iperf3-srv_10.42.42.10(pid=13943): Launched 02:29:52.874226 tst iperf3.py:8: start network... 02:29:53.077650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:53.546519 run create_hlr_db(pid=13944): Launched 02:29:53.663656 bus /gobi_6: Setting Powered False 02:29:54.723276 run create_hlr_db(pid=13944): Terminated: ok {rc=0} 02:29:55.165681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13946): Launched 02:29:55.491626 run osmo-hlr_10.42.42.2(pid=13947): Launched 02:29:55.616853 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:56.178768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13949): Launched 02:29:56.505634 run osmo-stp_10.42.42.5(pid=13950): Launched 02:29:56.631245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:29:57.196578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13952): Launched 02:29:57.321593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:29:57.596046 run patchelf(pid=13953): Launched 02:29:57.779118 run osmo-stp_10.42.42.5(pid=13950): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13950)] 02:29:57.916499 run osmo-stp_10.42.42.5(pid=13950): stdout: | (launched: 2022-12-10_02:29:56.446550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:58.055598 run osmo-stp_10.42.42.5(pid=13950): stderr: | [0;m[38;5;43m20221210022956638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022956639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022956639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022956639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:58.194896 run osmo-stp_10.42.42.5(pid=13950): stdout: | (launched: 2022-12-10_02:29:56.446550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:58.329393 run osmo-stp_10.42.42.5(pid=13950): stderr: | [0;m[38;5;43m20221210022956638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210022956639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210022956639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210022956639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210022956640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:58.487964 run patchelf(pid=13953): Terminating (SIGINT) 02:29:58.670835 run patchelf(pid=13953): Terminated: ok {rc=0} 02:29:58.802873 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13950): Process ended prematurely: osmo-stp_10.42.42.5(pid=13950) [trial-2368↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13950)] [trial-2368↪gprs:trx-b200↪iperf3.py:8] 02:29:58.812722 tst iperf3.py:8: Test FAILED (7.7 sec) 02:29:58.841661 run osmo-hlr_10.42.42.2(pid=13947): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13947)] 02:29:58.892044 run osmo-hlr_10.42.42.2(pid=13947): stdout: | (launched: 2022-12-10_02:29:55.432719) 02:29:58.944119 run osmo-hlr_10.42.42.2(pid=13947): stderr: | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210022955632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210022955645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210022955655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210022955655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210022955655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:58.996792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13942): Terminating (SIGTERM) 02:29:59.038553 run iperf3-srv_10.42.42.10(pid=13943): Terminating (SIGTERM) 02:29:59.080526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13946): Terminating (SIGTERM) 02:29:59.123098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13949): Terminating (SIGTERM) 02:29:59.165136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13952): Terminating (SIGTERM) 02:29:59.207492 --- ParallelTerminationStrategy: PID 13942 died... 02:29:59.227486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13942): Terminated: ok {rc=0} 02:29:59.274158 --- ParallelTerminationStrategy: PID 13943 died... 02:29:59.293713 run iperf3-srv_10.42.42.10(pid=13943): Terminated {rc=256} 02:29:59.339866 --- ParallelTerminationStrategy: PID 13946 died... 02:29:59.359593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13946): Terminated: ok {rc=0} 02:29:59.405953 --- ParallelTerminationStrategy: PID 13949 died... 02:29:59.425596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13949): Terminated: ok {rc=0} 02:29:59.471782 --- ParallelTerminationStrategy: PID 13952 died... 02:29:59.491541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13952): Terminated: ok {rc=0} 02:29:59.580323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 02:30:00.730362 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:00.742027 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:00.793604 tst iperf3m4.py: using LAC 25362 02:30:00.927357 tst iperf3m4.py: using RAC 117 02:30:01.063573 tst iperf3m4.py: using CellId 25362 02:30:01.192620 tst iperf3m4.py: using BVCI 25363 02:30:01.309310 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.321079 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.332601 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.345681 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.359375 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.370803 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.383317 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.395862 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:01.409816 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:01.532675 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:01.682556 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:01.826514 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:01.969362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:02.203887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:02.534623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13957): Launched 02:30:02.818620 run iperf3-srv_10.42.42.10(pid=13958): Launched 02:30:02.941477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:30:03.160023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:03.486356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13959): Launched 02:30:03.769127 run iperf3-srv_10.42.42.10(pid=13960): Launched 02:30:03.891413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:30:04.110576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:04.437299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Launched 02:30:04.720239 run iperf3-srv_10.42.42.10(pid=13962): Launched 02:30:04.842782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:30:05.060593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:05.386128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13963): Launched 02:30:05.668335 run iperf3-srv_10.42.42.10(pid=13964): Launched 02:30:05.791209 tst iperf3m4.py:8: start network... 02:30:06.009714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:06.516017 run create_hlr_db(pid=13965): Launched 02:30:06.648804 bus /gobi_6: Setting Powered False 02:30:07.713982 run create_hlr_db(pid=13965): Terminated: ok {rc=0} 02:30:08.165942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13967): Launched 02:30:08.491862 run osmo-hlr_10.42.42.2(pid=13968): Launched 02:30:08.616874 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:09.176801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13970): Launched 02:30:09.503197 run osmo-stp_10.42.42.5(pid=13971): Launched 02:30:09.627383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:10.186841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13973): Launched 02:30:10.312093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:10.586896 run patchelf(pid=13974): Launched 02:30:10.769199 run osmo-stp_10.42.42.5(pid=13971): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13971)] 02:30:10.908059 run osmo-stp_10.42.42.5(pid=13971): stdout: | (launched: 2022-12-10_02:30:09.442652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:11.047459 run osmo-stp_10.42.42.5(pid=13971): stderr: | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023009638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:11.186752 run osmo-stp_10.42.42.5(pid=13971): stdout: | (launched: 2022-12-10_02:30:09.442652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:11.320789 run osmo-stp_10.42.42.5(pid=13971): stderr: | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023009637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023009638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023009638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:11.479671 run patchelf(pid=13974): Terminating (SIGINT) 02:30:11.662791 run patchelf(pid=13974): Terminated: ok {rc=0} 02:30:11.794701 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13971): Process ended prematurely: osmo-stp_10.42.42.5(pid=13971) [trial-2368↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13971)] [trial-2368↪gprs:trx-b200↪iperf3m4.py:8] 02:30:11.804525 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:30:11.833345 run osmo-hlr_10.42.42.2(pid=13968): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13968)] 02:30:11.883775 run osmo-hlr_10.42.42.2(pid=13968): stdout: | (launched: 2022-12-10_02:30:08.432725) 02:30:11.935746 run osmo-hlr_10.42.42.2(pid=13968): stderr: | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023008631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023008643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023008652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023008652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023008652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:11.987878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13957): Terminating (SIGTERM) 02:30:12.029684 run iperf3-srv_10.42.42.10(pid=13958): Terminating (SIGTERM) 02:30:12.071378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13959): Terminating (SIGTERM) 02:30:12.113391 run iperf3-srv_10.42.42.10(pid=13960): Terminating (SIGTERM) 02:30:12.155055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Terminating (SIGTERM) 02:30:12.197252 run iperf3-srv_10.42.42.10(pid=13962): Terminating (SIGTERM) 02:30:12.238966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13963): Terminating (SIGTERM) 02:30:12.280884 run iperf3-srv_10.42.42.10(pid=13964): Terminating (SIGTERM) 02:30:12.323093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13967): Terminating (SIGTERM) 02:30:12.365085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13970): Terminating (SIGTERM) 02:30:12.406825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13973): Terminating (SIGTERM) 02:30:12.449094 --- ParallelTerminationStrategy: PID 13957 died... 02:30:12.469108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13957): Terminated: ok {rc=0} 02:30:12.515278 --- ParallelTerminationStrategy: PID 13958 died... 02:30:12.534855 run iperf3-srv_10.42.42.10(pid=13958): Terminated {rc=256} 02:30:12.580801 --- ParallelTerminationStrategy: PID 13959 died... 02:30:12.600756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13959): Terminated: ok {rc=0} 02:30:12.646806 --- ParallelTerminationStrategy: PID 13960 died... 02:30:12.666403 run iperf3-srv_10.42.42.10(pid=13960): Terminated {rc=256} 02:30:12.712750 --- ParallelTerminationStrategy: PID 13961 died... 02:30:12.732278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13961): Terminated: ok {rc=0} 02:30:12.778295 --- ParallelTerminationStrategy: PID 13962 died... 02:30:12.797739 run iperf3-srv_10.42.42.10(pid=13962): Terminated {rc=256} 02:30:12.843662 --- ParallelTerminationStrategy: PID 13963 died... 02:30:12.863179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13963): Terminated: ok {rc=0} 02:30:12.909120 --- ParallelTerminationStrategy: PID 13964 died... 02:30:12.928801 run iperf3-srv_10.42.42.10(pid=13964): Terminated {rc=256} 02:30:12.974562 --- ParallelTerminationStrategy: PID 13967 died... 02:30:12.994140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13967): Terminated: ok {rc=0} 02:30:13.039887 --- ParallelTerminationStrategy: PID 13970 died... 02:30:13.059539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13970): Terminated: ok {rc=0} 02:30:13.105636 --- ParallelTerminationStrategy: PID 13973 died... 02:30:13.125226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13973): Terminated: ok {rc=0} 02:30:13.213151 bus /gobi_4: Setting Powered False 02:30:14.313805 bus /gobi_4: Setting Powered False 02:30:15.431420 bus /gobi_1: Setting Powered False 02:30:16.529143 bus /gobi_1: Setting Powered False 02:30:17.645094 bus /gobi_0: Setting Powered False 02:30:18.742405 bus /gobi_0: Setting Powered False 02:30:19.857097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200 ping.py ---------------------------------------------- 02:30:20.959906 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:20.971669 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:21.021834 tst ping.py: using LAC 25363 02:30:21.149401 tst ping.py: using RAC 118 02:30:21.276026 tst ping.py: using CellId 25363 02:30:21.403716 tst ping.py: using BVCI 25364 02:30:21.519730 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.530788 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.541750 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.552783 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.563562 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.574428 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.585374 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:21.596121 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:21.711515 tst ping.py:19: start network... 02:30:21.912222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:22.372694 run create_hlr_db(pid=13975): Launched 02:30:22.487821 bus /gobi_6: Setting Powered False 02:30:23.547030 run create_hlr_db(pid=13975): Terminated: ok {rc=0} 02:30:23.984412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13977): Launched 02:30:24.304473 run osmo-hlr_10.42.42.2(pid=13978): Launched 02:30:24.427843 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:24.984196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13980): Launched 02:30:25.304545 run osmo-stp_10.42.42.5(pid=13981): Launched 02:30:25.427381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:25.979573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13983): Launched 02:30:26.102557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:26.371751 run patchelf(pid=13984): Launched 02:30:26.550984 run osmo-stp_10.42.42.5(pid=13981): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13981)] 02:30:26.686807 run osmo-stp_10.42.42.5(pid=13981): stdout: | (launched: 2022-12-10_02:30:25.246366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:26.824236 run osmo-stp_10.42.42.5(pid=13981): stderr: | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023025440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:26.961629 run osmo-stp_10.42.42.5(pid=13981): stdout: | (launched: 2022-12-10_02:30:25.246366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:27.093185 run osmo-stp_10.42.42.5(pid=13981): stderr: | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023025440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023025440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023025441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:27.248647 run patchelf(pid=13984): Terminating (SIGINT) 02:30:27.428447 run patchelf(pid=13984): Terminated: ok {rc=0} 02:30:27.557795 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13981): Process ended prematurely: osmo-stp_10.42.42.5(pid=13981) [trial-2368↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13981)] [trial-2368↪gprs:trx-b200↪ping.py:22] 02:30:27.567100 tst ping.py:22: Test FAILED (6.6 sec) 02:30:27.595337 run osmo-hlr_10.42.42.2(pid=13978): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13978)] 02:30:27.645713 run osmo-hlr_10.42.42.2(pid=13978): stdout: | (launched: 2022-12-10_02:30:24.246340) 02:30:27.697784 run osmo-hlr_10.42.42.2(pid=13978): stderr: | [0;m[1;31m20221210023024442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023024442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023024442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023024443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023024443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023024443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023024455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023024463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023024463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023024463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:27.750592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13977): Terminating (SIGTERM) 02:30:27.792934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13980): Terminating (SIGTERM) 02:30:27.835171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13983): Terminating (SIGTERM) 02:30:27.877576 --- ParallelTerminationStrategy: PID 13977 died... 02:30:27.897832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13977): Terminated: ok {rc=0} 02:30:27.944762 --- ParallelTerminationStrategy: PID 13980 died... 02:30:27.964767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13980): Terminated: ok {rc=0} 02:30:28.011366 --- ParallelTerminationStrategy: PID 13983 died... 02:30:28.031230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13983): Terminated: ok {rc=0} 02:30:28.120407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 02:30:29.207456 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.218791 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:29.271308 tst ping_idle_ping.py: using LAC 25364 02:30:29.403745 tst ping_idle_ping.py: using RAC 119 02:30:29.529168 tst ping_idle_ping.py: using CellId 25364 02:30:29.656405 tst ping_idle_ping.py: using BVCI 25365 02:30:29.777046 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.788212 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.799279 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.810485 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.821256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.832071 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.843077 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:29.853951 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:29.972305 tst ping_idle_ping.py:24: start network... 02:30:30.187824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:30.685739 run create_hlr_db(pid=13985): Launched 02:30:30.816276 bus /gobi_6: Setting Powered False 02:30:31.878614 run create_hlr_db(pid=13985): Terminated: ok {rc=0} 02:30:32.335460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13987): Launched 02:30:32.656115 run osmo-hlr_10.42.42.2(pid=13988): Launched 02:30:32.778664 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:33.331847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13990): Launched 02:30:33.651156 run osmo-stp_10.42.42.5(pid=13991): Launched 02:30:33.774815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:34.327000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13993): Launched 02:30:34.450737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:34.722495 run patchelf(pid=13994): Launched 02:30:34.902688 run osmo-stp_10.42.42.5(pid=13991): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13991)] 02:30:35.039190 run osmo-stp_10.42.42.5(pid=13991): stdout: | (launched: 2022-12-10_02:30:33.593208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:35.177216 run osmo-stp_10.42.42.5(pid=13991): stderr: | [0;m[38;5;43m20221210023033786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023033786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023033787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023033787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023033787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023033787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023033788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:35.315356 run osmo-stp_10.42.42.5(pid=13991): stdout: | (launched: 2022-12-10_02:30:33.593208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:35.447051 run osmo-stp_10.42.42.5(pid=13991): stderr: | [0;m[38;5;43m20221210023033786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023033786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023033787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023033787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023033787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023033787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023033788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:35.603054 run patchelf(pid=13994): Terminating (SIGINT) 02:30:35.783819 run patchelf(pid=13994): Terminated: ok {rc=0} 02:30:35.913569 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13991): Process ended prematurely: osmo-stp_10.42.42.5(pid=13991) [trial-2368↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13991)] [trial-2368↪gprs:trx-b200↪ping_idle_ping.py:27] 02:30:35.922987 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:30:35.951183 run osmo-hlr_10.42.42.2(pid=13988): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13988)] 02:30:36.001455 run osmo-hlr_10.42.42.2(pid=13988): stdout: | (launched: 2022-12-10_02:30:32.598207) 02:30:36.053433 run osmo-hlr_10.42.42.2(pid=13988): stderr: | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023032796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023032809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023032817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023032817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023032817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:36.105995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13987): Terminating (SIGTERM) 02:30:36.148184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13990): Terminating (SIGTERM) 02:30:36.190418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13993): Terminating (SIGTERM) 02:30:36.232708 --- ParallelTerminationStrategy: PID 13987 died... 02:30:36.253244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13987): Terminated: ok {rc=0} 02:30:36.299876 --- ParallelTerminationStrategy: PID 13990 died... 02:30:36.319683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13990): Terminated: ok {rc=0} 02:30:36.365993 --- ParallelTerminationStrategy: PID 13993 died... 02:30:36.385982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13993): Terminated: ok {rc=0} 02:30:36.474693 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 02:30:37.788330 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:30:37.794009 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:30:37.827379 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:30:37.866600 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:30:37.954733 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:30:37.988084 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:30:38.027374 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:30:38.623471 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:30:38.675233 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:38.686432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:30:38.738338 tst cs_paging_gprs_active.py: using LAC 25365 02:30:38.867184 tst cs_paging_gprs_active.py: using RAC 120 02:30:38.996382 tst cs_paging_gprs_active.py: using CellId 25365 02:30:39.124263 tst cs_paging_gprs_active.py: using BVCI 25366 02:30:39.244230 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.255468 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.266484 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.277558 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.288500 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.299688 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.310929 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.321827 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:39.332890 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:30:39.451183 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:30:39.567397 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:30:39.772033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:40.077640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Launched 02:30:40.344033 run iperf3-srv_10.42.42.10(pid=14002): Launched 02:30:40.459245 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:30:40.663275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:40.969013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14003): Launched 02:30:41.233611 run iperf3-srv_10.42.42.10(pid=14004): Launched 02:30:41.349219 tst cs_paging_gprs_active.py:38: start network... 02:30:41.552787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:42.025971 run create_hlr_db(pid=14005): Launched 02:30:42.146131 bus /gobi_6: Setting Powered False 02:30:43.206387 run create_hlr_db(pid=14005): Terminated: ok {rc=0} 02:30:43.629132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Launched 02:30:43.933981 run osmo-hlr_10.42.42.2(pid=14008): Launched 02:30:44.050719 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:44.588918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Launched 02:30:44.894127 run osmo-stp_10.42.42.5(pid=14011): Launched 02:30:45.011531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:45.534974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14013): Launched 02:30:45.652131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:45.934106 run patchelf(pid=14014): Launched 02:30:46.138117 run osmo-stp_10.42.42.5(pid=14011): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] 02:30:46.279736 run osmo-stp_10.42.42.5(pid=14011): stdout: | (launched: 2022-12-10_02:30:44.838447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:46.441791 run osmo-stp_10.42.42.5(pid=14011): stderr: | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023045010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:46.588052 run osmo-stp_10.42.42.5(pid=14011): stdout: | (launched: 2022-12-10_02:30:44.838447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:46.727524 run osmo-stp_10.42.42.5(pid=14011): stderr: | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023045010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023045010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023045011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:46.889698 run patchelf(pid=14014): Terminating (SIGINT) 02:30:47.078706 run patchelf(pid=14014): Terminated: ok {rc=0} 02:30:47.213967 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14011): Process ended prematurely: osmo-stp_10.42.42.5(pid=14011) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:30:47.224376 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:30:47.253363 run osmo-hlr_10.42.42.2(pid=14008): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14008)] 02:30:47.303695 run osmo-hlr_10.42.42.2(pid=14008): stdout: | (launched: 2022-12-10_02:30:43.878394) 02:30:47.355761 run osmo-hlr_10.42.42.2(pid=14008): stderr: | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023044056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023044068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023044076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023044077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023044077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:47.408086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Terminating (SIGTERM) 02:30:47.450379 run iperf3-srv_10.42.42.10(pid=14002): Terminating (SIGTERM) 02:30:47.492369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14003): Terminating (SIGTERM) 02:30:47.534256 run iperf3-srv_10.42.42.10(pid=14004): Terminating (SIGTERM) 02:30:47.576144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Terminating (SIGTERM) 02:30:47.618229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Terminating (SIGTERM) 02:30:47.660194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14013): Terminating (SIGTERM) 02:30:47.702610 --- ParallelTerminationStrategy: PID 14001 died... 02:30:47.723101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Terminated: ok {rc=0} 02:30:47.769600 --- ParallelTerminationStrategy: PID 14002 died... 02:30:47.789179 run iperf3-srv_10.42.42.10(pid=14002): Terminated {rc=256} 02:30:47.835134 --- ParallelTerminationStrategy: PID 14003 died... 02:30:47.854751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14003): Terminated: ok {rc=0} 02:30:47.901112 --- ParallelTerminationStrategy: PID 14004 died... 02:30:47.920577 run iperf3-srv_10.42.42.10(pid=14004): Terminated {rc=256} 02:30:47.966864 --- ParallelTerminationStrategy: PID 14007 died... 02:30:47.986523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14007): Terminated: ok {rc=0} 02:30:48.032803 --- ParallelTerminationStrategy: PID 14010 died... 02:30:48.052802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14010): Terminated: ok {rc=0} 02:30:48.099367 --- ParallelTerminationStrategy: PID 14013 died... 02:30:48.119091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14013): Terminated: ok {rc=0} 02:30:48.207260 bus /gobi_0: Setting Powered False 02:30:49.306795 bus /gobi_0: Setting Powered False 02:30:50.422438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:30:51.572694 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:51.584565 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:30:51.639370 tst iperf3.py: using LAC 25366 02:30:51.768802 tst iperf3.py: using RAC 121 02:30:51.900517 tst iperf3.py: using CellId 25366 02:30:52.027512 tst iperf3.py: using BVCI 25367 02:30:52.145740 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.157170 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.168308 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.179325 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.190566 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.201730 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.213138 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.223931 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:52.235092 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:30:52.351742 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:52.557538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:52.863763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Launched 02:30:53.129746 run iperf3-srv_10.42.42.10(pid=14016): Launched 02:30:53.244934 tst iperf3.py:8: start network... 02:30:53.449025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:53.920898 run create_hlr_db(pid=14017): Launched 02:30:54.038439 bus /gobi_6: Setting Powered False 02:30:55.098482 run create_hlr_db(pid=14017): Terminated: ok {rc=0} 02:30:55.542495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14019): Launched 02:30:55.868468 run osmo-hlr_10.42.42.2(pid=14020): Launched 02:30:55.992390 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:56.557443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14022): Launched 02:30:56.884100 run osmo-stp_10.42.42.5(pid=14023): Launched 02:30:57.008509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:57.568829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14025): Launched 02:30:57.693279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:57.967120 run patchelf(pid=14026): Launched 02:30:58.147988 run osmo-stp_10.42.42.5(pid=14023): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14023)] 02:30:58.285476 run osmo-stp_10.42.42.5(pid=14023): stdout: | (launched: 2022-12-10_02:30:56.825057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:58.424452 run osmo-stp_10.42.42.5(pid=14023): stderr: | [0;m[38;5;43m20221210023057019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023057019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023057020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023057020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:58.563604 run osmo-stp_10.42.42.5(pid=14023): stdout: | (launched: 2022-12-10_02:30:56.825057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:58.697697 run osmo-stp_10.42.42.5(pid=14023): stderr: | [0;m[38;5;43m20221210023057019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023057019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023057020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023057020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023057021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:58.856160 run patchelf(pid=14026): Terminating (SIGINT) 02:30:59.038970 run patchelf(pid=14026): Terminated: ok {rc=0} 02:30:59.170226 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14023): Process ended prematurely: osmo-stp_10.42.42.5(pid=14023) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14023)] [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 02:30:59.180193 tst iperf3.py:8: Test FAILED (7.6 sec) 02:30:59.208655 run osmo-hlr_10.42.42.2(pid=14020): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14020)] 02:30:59.258596 run osmo-hlr_10.42.42.2(pid=14020): stdout: | (launched: 2022-12-10_02:30:55.809884) 02:30:59.310562 run osmo-hlr_10.42.42.2(pid=14020): stderr: | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023056011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023056023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:59.363201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminating (SIGTERM) 02:30:59.404897 run iperf3-srv_10.42.42.10(pid=14016): Terminating (SIGTERM) 02:30:59.446821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14019): Terminating (SIGTERM) 02:30:59.488639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14022): Terminating (SIGTERM) 02:30:59.530640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14025): Terminating (SIGTERM) 02:30:59.572820 --- ParallelTerminationStrategy: PID 14015 died... 02:30:59.592920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminated: ok {rc=0} 02:30:59.639138 --- ParallelTerminationStrategy: PID 14016 died... 02:30:59.658740 run iperf3-srv_10.42.42.10(pid=14016): Terminated {rc=256} 02:30:59.704639 --- ParallelTerminationStrategy: PID 14019 died... 02:30:59.724615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14019): Terminated: ok {rc=0} 02:30:59.770578 --- ParallelTerminationStrategy: PID 14022 died... 02:30:59.790330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14022): Terminated: ok {rc=0} 02:30:59.836303 --- ParallelTerminationStrategy: PID 14025 died... 02:30:59.855873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14025): Terminated: ok {rc=0} 02:30:59.943515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:31:01.092620 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.106549 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:01.159001 tst iperf3m4.py: using LAC 25367 02:31:01.316732 tst iperf3m4.py: using RAC 122 02:31:01.439972 tst iperf3m4.py: using CellId 25367 02:31:01.571727 tst iperf3m4.py: using BVCI 25368 02:31:01.723811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.739133 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.755546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.771839 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.787082 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.802491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.818188 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.833796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:01.849933 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:02.003127 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:02.138867 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:02.278854 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:02.402387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:02.622476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:02.950070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14027): Launched 02:31:03.234311 run iperf3-srv_10.42.42.10(pid=14028): Launched 02:31:03.357259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:31:03.575880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:03.904006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Launched 02:31:04.187271 run iperf3-srv_10.42.42.10(pid=14030): Launched 02:31:04.310283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:31:04.529691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:04.856840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14031): Launched 02:31:05.139952 run iperf3-srv_10.42.42.10(pid=14032): Launched 02:31:05.262959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:31:05.482179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:05.810924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14033): Launched 02:31:06.094207 run iperf3-srv_10.42.42.10(pid=14034): Launched 02:31:06.216923 tst iperf3m4.py:8: start network... 02:31:06.435937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:06.942566 run create_hlr_db(pid=14035): Launched 02:31:07.074902 bus /gobi_6: Setting Powered False 02:31:08.138964 run create_hlr_db(pid=14035): Terminated: ok {rc=0} 02:31:08.591769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14037): Launched 02:31:08.920366 run osmo-hlr_10.42.42.2(pid=14038): Launched 02:31:09.044748 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:09.606252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14040): Launched 02:31:09.932786 run osmo-stp_10.42.42.5(pid=14041): Launched 02:31:10.057786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:10.620451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14043): Launched 02:31:10.746339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:11.022656 run patchelf(pid=14044): Launched 02:31:11.204102 run osmo-stp_10.42.42.5(pid=14041): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14041)] 02:31:11.342086 run osmo-stp_10.42.42.5(pid=14041): stdout: | (launched: 2022-12-10_02:31:09.873780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:11.481023 run osmo-stp_10.42.42.5(pid=14041): stderr: | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023110068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:11.619977 run osmo-stp_10.42.42.5(pid=14041): stdout: | (launched: 2022-12-10_02:31:09.873780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:11.754210 run osmo-stp_10.42.42.5(pid=14041): stderr: | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023110067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023110068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023110070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:11.912479 run patchelf(pid=14044): Terminating (SIGINT) 02:31:12.095245 run patchelf(pid=14044): Terminated: ok {rc=0} 02:31:12.226386 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14041): Process ended prematurely: osmo-stp_10.42.42.5(pid=14041) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14041)] [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 02:31:12.236255 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:31:12.265090 run osmo-hlr_10.42.42.2(pid=14038): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14038)] 02:31:12.315217 run osmo-hlr_10.42.42.2(pid=14038): stdout: | (launched: 2022-12-10_02:31:08.861061) 02:31:12.367289 run osmo-hlr_10.42.42.2(pid=14038): stderr: | [0;m[1;31m20221210023109060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023109060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023109060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023109060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023109060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023109061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023109073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023109081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023109082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023109082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:12.419696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14027): Terminating (SIGTERM) 02:31:12.461945 run iperf3-srv_10.42.42.10(pid=14028): Terminating (SIGTERM) 02:31:12.503972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Terminating (SIGTERM) 02:31:12.546323 run iperf3-srv_10.42.42.10(pid=14030): Terminating (SIGTERM) 02:31:12.588415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14031): Terminating (SIGTERM) 02:31:12.630538 run iperf3-srv_10.42.42.10(pid=14032): Terminating (SIGTERM) 02:31:12.672625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14033): Terminating (SIGTERM) 02:31:12.715437 run iperf3-srv_10.42.42.10(pid=14034): Terminating (SIGTERM) 02:31:12.758009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14037): Terminating (SIGTERM) 02:31:12.800570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14040): Terminating (SIGTERM) 02:31:12.842726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14043): Terminating (SIGTERM) 02:31:12.885195 --- ParallelTerminationStrategy: PID 14027 died... 02:31:12.905368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14027): Terminated: ok {rc=0} 02:31:12.951881 --- ParallelTerminationStrategy: PID 14028 died... 02:31:12.971692 run iperf3-srv_10.42.42.10(pid=14028): Terminated {rc=256} 02:31:13.017856 --- ParallelTerminationStrategy: PID 14029 died... 02:31:13.037569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Terminated: ok {rc=0} 02:31:13.083550 --- ParallelTerminationStrategy: PID 14030 died... 02:31:13.103153 run iperf3-srv_10.42.42.10(pid=14030): Terminated {rc=256} 02:31:13.149235 --- ParallelTerminationStrategy: PID 14031 died... 02:31:13.168668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14031): Terminated: ok {rc=0} 02:31:13.214836 --- ParallelTerminationStrategy: PID 14032 died... 02:31:13.234534 run iperf3-srv_10.42.42.10(pid=14032): Terminated {rc=256} 02:31:13.280772 --- ParallelTerminationStrategy: PID 14033 died... 02:31:13.300378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14033): Terminated: ok {rc=0} 02:31:13.346210 --- ParallelTerminationStrategy: PID 14034 died... 02:31:13.365975 run iperf3-srv_10.42.42.10(pid=14034): Terminated {rc=256} 02:31:13.411850 --- ParallelTerminationStrategy: PID 14037 died... 02:31:13.431414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14037): Terminated: ok {rc=0} 02:31:13.477372 --- ParallelTerminationStrategy: PID 14040 died... 02:31:13.497087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14040): Terminated: ok {rc=0} 02:31:13.542946 --- ParallelTerminationStrategy: PID 14043 died... 02:31:13.562710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14043): Terminated: ok {rc=0} 02:31:13.650564 bus /gobi_4: Setting Powered False 02:31:14.749082 bus /gobi_4: Setting Powered False 02:31:15.889220 bus /gobi_1: Setting Powered False 02:31:17.014939 bus /gobi_1: Setting Powered False 02:31:18.146215 bus /gobi_0: Setting Powered False 02:31:19.244179 bus /gobi_0: Setting Powered False 02:31:20.360687 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 02:31:21.463467 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:21.475491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:21.527171 tst ping.py: using LAC 25368 02:31:21.654435 tst ping.py: using RAC 123 02:31:21.780140 tst ping.py: using CellId 25368 02:31:21.905054 tst ping.py: using BVCI 25369 02:31:22.021301 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.032541 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.043709 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.054924 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.066005 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.076916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.088240 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:22.099401 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:22.218535 tst ping.py:19: start network... 02:31:22.418608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:22.878696 run create_hlr_db(pid=14045): Launched 02:31:22.993712 bus /gobi_6: Setting Powered False 02:31:24.053696 run create_hlr_db(pid=14045): Terminated: ok {rc=0} 02:31:24.470213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Launched 02:31:24.768144 run osmo-hlr_10.42.42.2(pid=14048): Launched 02:31:24.882828 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:25.398846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Launched 02:31:25.697068 run osmo-stp_10.42.42.5(pid=14051): Launched 02:31:25.811024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:26.325744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Launched 02:31:26.441196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:26.694651 run patchelf(pid=14054): Launched 02:31:26.862343 run osmo-stp_10.42.42.5(pid=14051): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] 02:31:26.989282 run osmo-stp_10.42.42.5(pid=14051): stdout: | (launched: 2022-12-10_02:31:25.642356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:27.117819 run osmo-stp_10.42.42.5(pid=14051): stderr: | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023125816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:27.246443 run osmo-stp_10.42.42.5(pid=14051): stdout: | (launched: 2022-12-10_02:31:25.642356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:27.369413 run osmo-stp_10.42.42.5(pid=14051): stderr: | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023125815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023125816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023125816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:27.514837 run patchelf(pid=14054): Terminating (SIGINT) 02:31:27.683237 run patchelf(pid=14054): Terminated: ok {rc=0} 02:31:27.804166 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14051): Process ended prematurely: osmo-stp_10.42.42.5(pid=14051) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 02:31:27.813080 tst ping.py:22: Test FAILED (6.3 sec) 02:31:27.840230 run osmo-hlr_10.42.42.2(pid=14048): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14048)] 02:31:27.888631 run osmo-hlr_10.42.42.2(pid=14048): stdout: | (launched: 2022-12-10_02:31:24.713804) 02:31:27.938686 run osmo-hlr_10.42.42.2(pid=14048): stderr: | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023124889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023124902 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023124910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023124910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023124910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:27.989217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Terminating (SIGTERM) 02:31:28.029425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Terminating (SIGTERM) 02:31:28.069568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Terminating (SIGTERM) 02:31:28.110319 --- ParallelTerminationStrategy: PID 14047 died... 02:31:28.129776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Terminated: ok {rc=0} 02:31:28.174708 --- ParallelTerminationStrategy: PID 14050 died... 02:31:28.193492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Terminated: ok {rc=0} 02:31:28.238239 --- ParallelTerminationStrategy: PID 14053 died... 02:31:28.257014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Terminated: ok {rc=0} 02:31:28.341868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:31:29.428241 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:29.440559 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:29.493837 tst ping_idle_ping.py: using LAC 25369 02:31:29.621201 tst ping_idle_ping.py: using RAC 124 02:31:29.745377 tst ping_idle_ping.py: using CellId 25369 02:31:29.870163 tst ping_idle_ping.py: using BVCI 25370 02:31:29.985881 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:29.997268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.008358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.019497 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.030696 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.041758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.053095 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:30.064088 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:30.183754 tst ping_idle_ping.py:24: start network... 02:31:30.400918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:30.915951 run create_hlr_db(pid=14055): Launched 02:31:31.065224 bus /gobi_6: Setting Powered False 02:31:32.127765 run create_hlr_db(pid=14055): Terminated: ok {rc=0} 02:31:32.553594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14057): Launched 02:31:32.854461 run osmo-hlr_10.42.42.2(pid=14058): Launched 02:31:32.970306 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:33.498972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14060): Launched 02:31:33.799227 run osmo-stp_10.42.42.5(pid=14061): Launched 02:31:33.914117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:34.430680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14063): Launched 02:31:34.545961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:34.799020 run patchelf(pid=14064): Launched 02:31:34.968199 run osmo-stp_10.42.42.5(pid=14061): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14061)] 02:31:35.096183 run osmo-stp_10.42.42.5(pid=14061): stdout: | (launched: 2022-12-10_02:31:33.744307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:35.225427 run osmo-stp_10.42.42.5(pid=14061): stderr: | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023133916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:35.354818 run osmo-stp_10.42.42.5(pid=14061): stdout: | (launched: 2022-12-10_02:31:33.744307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:35.478010 run osmo-stp_10.42.42.5(pid=14061): stderr: | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023133915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023133916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023133916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:35.623795 run patchelf(pid=14064): Terminating (SIGINT) 02:31:35.792456 run patchelf(pid=14064): Terminated: ok {rc=0} 02:31:35.914803 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14061): Process ended prematurely: osmo-stp_10.42.42.5(pid=14061) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14061)] [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 02:31:35.923559 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:31:35.950771 run osmo-hlr_10.42.42.2(pid=14058): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14058)] 02:31:35.998788 run osmo-hlr_10.42.42.2(pid=14058): stdout: | (launched: 2022-12-10_02:31:32.799077) 02:31:36.048466 run osmo-hlr_10.42.42.2(pid=14058): stderr: | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023132977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023132990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023133000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023133000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023133000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:36.098796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14057): Terminating (SIGTERM) 02:31:36.138662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14060): Terminating (SIGTERM) 02:31:36.178801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14063): Terminating (SIGTERM) 02:31:36.219424 --- ParallelTerminationStrategy: PID 14057 died... 02:31:36.238690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14057): Terminated: ok {rc=0} 02:31:36.283651 --- ParallelTerminationStrategy: PID 14060 died... 02:31:36.302549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14060): Terminated: ok {rc=0} 02:31:36.347097 --- ParallelTerminationStrategy: PID 14063 died... 02:31:36.366294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14063): Terminated: ok {rc=0} 02:31:36.452690 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:31:37.764780 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:31:37.771174 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:31:37.805464 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:31:37.843576 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:31:37.928572 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:31:37.961224 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:31:37.998994 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:31:38.594840 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:31:38.643965 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:38.654794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:31:38.721772 tst cs_paging_gprs_active.py: using LAC 25370 02:31:38.840019 tst cs_paging_gprs_active.py: using RAC 125 02:31:38.957700 tst cs_paging_gprs_active.py: using CellId 25370 02:31:39.078799 tst cs_paging_gprs_active.py: using BVCI 25371 02:31:39.191600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.202441 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.213076 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.223891 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.234641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.245559 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.256399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.267187 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:39.278211 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:31:39.398692 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:31:39.515410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:31:39.719572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:40.025043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14068): Launched 02:31:40.289418 run iperf3-srv_10.42.42.10(pid=14069): Launched 02:31:40.404169 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:31:40.607455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:40.911860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14070): Launched 02:31:41.177018 run iperf3-srv_10.42.42.10(pid=14071): Launched 02:31:41.291544 tst cs_paging_gprs_active.py:38: start network... 02:31:41.494958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:41.964583 run create_hlr_db(pid=14072): Launched 02:31:42.081929 bus /gobi_6: Setting Powered False 02:31:43.142557 run create_hlr_db(pid=14072): Terminated: ok {rc=0} 02:31:43.585564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Launched 02:31:43.912890 run osmo-hlr_10.42.42.2(pid=14075): Launched 02:31:44.038042 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:44.597762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Launched 02:31:44.923219 run osmo-stp_10.42.42.5(pid=14078): Launched 02:31:45.048867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:45.609480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Launched 02:31:45.734625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:46.045757 run patchelf(pid=14081): Launched 02:31:46.229875 run osmo-stp_10.42.42.5(pid=14078): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] 02:31:46.370158 run osmo-stp_10.42.42.5(pid=14078): stdout: | (launched: 2022-12-10_02:31:44.864089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:46.514435 run osmo-stp_10.42.42.5(pid=14078): stderr: | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023145059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:46.656750 run osmo-stp_10.42.42.5(pid=14078): stdout: | (launched: 2022-12-10_02:31:44.864089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:46.793792 run osmo-stp_10.42.42.5(pid=14078): stderr: | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023145058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023145059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023145059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:46.955713 run patchelf(pid=14081): Terminating (SIGINT) 02:31:47.141778 run patchelf(pid=14081): Terminated: ok {rc=0} 02:31:47.273760 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14078): Process ended prematurely: osmo-stp_10.42.42.5(pid=14078) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:31:47.283996 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:31:47.312696 run osmo-hlr_10.42.42.2(pid=14075): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14075)] 02:31:47.362766 run osmo-hlr_10.42.42.2(pid=14075): stdout: | (launched: 2022-12-10_02:31:43.853718) 02:31:47.414624 run osmo-hlr_10.42.42.2(pid=14075): stderr: | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023144054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023144066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023144074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023144075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023144075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:47.466961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14068): Terminating (SIGTERM) 02:31:47.509277 run iperf3-srv_10.42.42.10(pid=14069): Terminating (SIGTERM) 02:31:47.551023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14070): Terminating (SIGTERM) 02:31:47.592820 run iperf3-srv_10.42.42.10(pid=14071): Terminating (SIGTERM) 02:31:47.634444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Terminating (SIGTERM) 02:31:47.676291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Terminating (SIGTERM) 02:31:47.718086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Terminating (SIGTERM) 02:31:47.760297 --- ParallelTerminationStrategy: PID 14068 died... 02:31:47.780474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14068): Terminated: ok {rc=0} 02:31:47.826834 --- ParallelTerminationStrategy: PID 14069 died... 02:31:47.846336 run iperf3-srv_10.42.42.10(pid=14069): Terminated {rc=256} 02:31:47.892163 --- ParallelTerminationStrategy: PID 14070 died... 02:31:47.911953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14070): Terminated: ok {rc=0} 02:31:47.958208 --- ParallelTerminationStrategy: PID 14071 died... 02:31:47.978109 run iperf3-srv_10.42.42.10(pid=14071): Terminated {rc=256} 02:31:48.024206 --- ParallelTerminationStrategy: PID 14074 died... 02:31:48.043691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14074): Terminated: ok {rc=0} 02:31:48.089779 --- ParallelTerminationStrategy: PID 14077 died... 02:31:48.109616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14077): Terminated: ok {rc=0} 02:31:48.155683 --- ParallelTerminationStrategy: PID 14080 died... 02:31:48.175405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14080): Terminated: ok {rc=0} 02:31:48.263261 bus /gobi_0: Setting Powered False 02:31:49.363630 bus /gobi_0: Setting Powered False 02:31:50.478448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:31:51.622849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:51.634304 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:31:51.706312 tst iperf3.py: using LAC 25371 02:31:51.825111 tst iperf3.py: using RAC 126 02:31:51.945727 tst iperf3.py: using CellId 25371 02:31:52.066300 tst iperf3.py: using BVCI 25372 02:31:52.178435 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.189304 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.199956 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.210988 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.221583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.232710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.244105 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.254869 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:52.265982 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:31:52.381492 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:52.584409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:52.889224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Launched 02:31:53.153761 run iperf3-srv_10.42.42.10(pid=14083): Launched 02:31:53.268671 tst iperf3.py:8: start network... 02:31:53.472225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:53.943151 run create_hlr_db(pid=14084): Launched 02:31:54.060328 bus /gobi_6: Setting Powered False 02:31:55.121651 run create_hlr_db(pid=14084): Terminated: ok {rc=0} 02:31:55.565425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14086): Launched 02:31:55.892158 run osmo-hlr_10.42.42.2(pid=14087): Launched 02:31:56.016772 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:56.577464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14089): Launched 02:31:56.905616 run osmo-stp_10.42.42.5(pid=14090): Launched 02:31:57.031368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:57.595436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14092): Launched 02:31:57.720351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:57.995965 run patchelf(pid=14093): Launched 02:31:58.178352 run osmo-stp_10.42.42.5(pid=14090): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14090)] 02:31:58.316028 run osmo-stp_10.42.42.5(pid=14090): stdout: | (launched: 2022-12-10_02:31:56.844915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:58.455566 run osmo-stp_10.42.42.5(pid=14090): stderr: | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023157037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:58.594449 run osmo-stp_10.42.42.5(pid=14090): stdout: | (launched: 2022-12-10_02:31:56.844915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:58.728524 run osmo-stp_10.42.42.5(pid=14090): stderr: | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023157037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023157037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023157038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:58.887657 run patchelf(pid=14093): Terminating (SIGINT) 02:31:59.070805 run patchelf(pid=14093): Terminated: ok {rc=0} 02:31:59.203128 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14090): Process ended prematurely: osmo-stp_10.42.42.5(pid=14090) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14090)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 02:31:59.213128 tst iperf3.py:8: Test FAILED (7.6 sec) 02:31:59.241636 run osmo-hlr_10.42.42.2(pid=14087): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14087)] 02:31:59.292019 run osmo-hlr_10.42.42.2(pid=14087): stdout: | (launched: 2022-12-10_02:31:55.832914) 02:31:59.344223 run osmo-hlr_10.42.42.2(pid=14087): stderr: | [0;m[1;31m20221210023156033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023156033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023156033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023156034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023156034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023156034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023156046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023156054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023156054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023156054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:59.396921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminating (SIGTERM) 02:31:59.439028 run iperf3-srv_10.42.42.10(pid=14083): Terminating (SIGTERM) 02:31:59.482465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14086): Terminating (SIGTERM) 02:31:59.524938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14089): Terminating (SIGTERM) 02:31:59.567129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14092): Terminating (SIGTERM) 02:31:59.609596 --- ParallelTerminationStrategy: PID 14082 died... 02:31:59.629663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminated: ok {rc=0} 02:31:59.676199 --- ParallelTerminationStrategy: PID 14083 died... 02:31:59.696085 run iperf3-srv_10.42.42.10(pid=14083): Terminated {rc=256} 02:31:59.742552 --- ParallelTerminationStrategy: PID 14086 died... 02:31:59.762583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14086): Terminated: ok {rc=0} 02:31:59.809270 --- ParallelTerminationStrategy: PID 14089 died... 02:31:59.828620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14089): Terminated: ok {rc=0} 02:31:59.874534 --- ParallelTerminationStrategy: PID 14092 died... 02:31:59.894072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14092): Terminated: ok {rc=0} 02:31:59.982161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:32:01.132364 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.145462 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:01.217921 tst iperf3m4.py: using LAC 25372 02:32:01.344428 tst iperf3m4.py: using RAC 127 02:32:01.475016 tst iperf3m4.py: using CellId 25372 02:32:01.605159 tst iperf3m4.py: using BVCI 25373 02:32:01.721545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.733494 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.745294 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.759347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.772029 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.783756 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.796452 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.809591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:01.822156 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:01.948080 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:02.094223 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:02.222335 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:02.344857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:02.564599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:02.891707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14094): Launched 02:32:03.175839 run iperf3-srv_10.42.42.10(pid=14095): Launched 02:32:03.299528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:32:03.519068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:03.846088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Launched 02:32:04.130185 run iperf3-srv_10.42.42.10(pid=14097): Launched 02:32:04.253304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:32:04.472688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:04.800904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14098): Launched 02:32:05.084579 run iperf3-srv_10.42.42.10(pid=14099): Launched 02:32:05.207747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:32:05.428390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:05.755382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14100): Launched 02:32:06.038535 run iperf3-srv_10.42.42.10(pid=14101): Launched 02:32:06.161278 tst iperf3m4.py:8: start network... 02:32:06.380446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:06.885657 run create_hlr_db(pid=14102): Launched 02:32:07.019887 bus /gobi_6: Setting Powered False 02:32:08.083593 run create_hlr_db(pid=14102): Terminated: ok {rc=0} 02:32:08.516436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14104): Launched 02:32:08.822189 run osmo-hlr_10.42.42.2(pid=14105): Launched 02:32:08.938553 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:09.502983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14107): Launched 02:32:09.828721 run osmo-stp_10.42.42.5(pid=14108): Launched 02:32:09.952370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:10.511901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14110): Launched 02:32:10.636238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:10.911654 run patchelf(pid=14111): Launched 02:32:11.092734 run osmo-stp_10.42.42.5(pid=14108): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14108)] 02:32:11.230270 run osmo-stp_10.42.42.5(pid=14108): stdout: | (launched: 2022-12-10_02:32:09.769602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:11.369509 run osmo-stp_10.42.42.5(pid=14108): stderr: | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023209965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:11.508098 run osmo-stp_10.42.42.5(pid=14108): stdout: | (launched: 2022-12-10_02:32:09.769602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:11.641643 run osmo-stp_10.42.42.5(pid=14108): stderr: | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023209964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023209965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023209967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:11.799907 run patchelf(pid=14111): Terminating (SIGINT) 02:32:11.982756 run patchelf(pid=14111): Terminated: ok {rc=0} 02:32:12.115437 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14108): Process ended prematurely: osmo-stp_10.42.42.5(pid=14108) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14108)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:32:12.125323 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:32:12.153966 run osmo-hlr_10.42.42.2(pid=14105): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14105)] 02:32:12.203938 run osmo-hlr_10.42.42.2(pid=14105): stdout: | (launched: 2022-12-10_02:32:08.766278) 02:32:12.255417 run osmo-hlr_10.42.42.2(pid=14105): stderr: | [0;m[1;31m20221210023208944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023208944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023208944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023208945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023208945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023208945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023208956 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023208965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023208966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023208966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:12.307113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14094): Terminating (SIGTERM) 02:32:12.348620 run iperf3-srv_10.42.42.10(pid=14095): Terminating (SIGTERM) 02:32:12.390143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Terminating (SIGTERM) 02:32:12.431647 run iperf3-srv_10.42.42.10(pid=14097): Terminating (SIGTERM) 02:32:12.473116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14098): Terminating (SIGTERM) 02:32:12.514694 run iperf3-srv_10.42.42.10(pid=14099): Terminating (SIGTERM) 02:32:12.556025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14100): Terminating (SIGTERM) 02:32:12.597525 run iperf3-srv_10.42.42.10(pid=14101): Terminating (SIGTERM) 02:32:12.638849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14104): Terminating (SIGTERM) 02:32:12.680320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14107): Terminating (SIGTERM) 02:32:12.721891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14110): Terminating (SIGTERM) 02:32:12.764350 --- ParallelTerminationStrategy: PID 14094 died... 02:32:12.784452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14094): Terminated: ok {rc=0} 02:32:12.831133 --- ParallelTerminationStrategy: PID 14095 died... 02:32:12.850799 run iperf3-srv_10.42.42.10(pid=14095): Terminated {rc=256} 02:32:12.896782 --- ParallelTerminationStrategy: PID 14096 died... 02:32:12.916823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Terminated: ok {rc=0} 02:32:12.962778 --- ParallelTerminationStrategy: PID 14097 died... 02:32:12.982383 run iperf3-srv_10.42.42.10(pid=14097): Terminated {rc=256} 02:32:13.028791 --- ParallelTerminationStrategy: PID 14098 died... 02:32:13.048770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14098): Terminated: ok {rc=0} 02:32:13.094806 --- ParallelTerminationStrategy: PID 14099 died... 02:32:13.114514 run iperf3-srv_10.42.42.10(pid=14099): Terminated {rc=256} 02:32:13.160466 --- ParallelTerminationStrategy: PID 14100 died... 02:32:13.180086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14100): Terminated: ok {rc=0} 02:32:13.226097 --- ParallelTerminationStrategy: PID 14101 died... 02:32:13.245719 run iperf3-srv_10.42.42.10(pid=14101): Terminated {rc=256} 02:32:13.292071 --- ParallelTerminationStrategy: PID 14104 died... 02:32:13.311755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14104): Terminated: ok {rc=0} 02:32:13.357824 --- ParallelTerminationStrategy: PID 14107 died... 02:32:13.377484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14107): Terminated: ok {rc=0} 02:32:13.423435 --- ParallelTerminationStrategy: PID 14110 died... 02:32:13.443073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14110): Terminated: ok {rc=0} 02:32:13.530864 bus /gobi_4: Setting Powered False 02:32:14.629391 bus /gobi_4: Setting Powered False 02:32:15.745413 bus /gobi_1: Setting Powered False 02:32:16.844577 bus /gobi_1: Setting Powered False 02:32:17.964228 bus /gobi_0: Setting Powered False 02:32:19.063451 bus /gobi_0: Setting Powered False 02:32:20.181490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:32:21.284918 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.296504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:21.366218 tst ping.py: using LAC 25373 02:32:21.486233 tst ping.py: using RAC 128 02:32:21.608926 tst ping.py: using CellId 25373 02:32:21.726599 tst ping.py: using BVCI 25374 02:32:21.837545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.848356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.859080 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.870168 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.881106 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.892922 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.904273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:21.915452 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:22.030987 tst ping.py:19: start network... 02:32:22.231227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:22.694746 run create_hlr_db(pid=14112): Launched 02:32:22.808733 bus /gobi_6: Setting Powered False 02:32:23.868685 run create_hlr_db(pid=14112): Terminated: ok {rc=0} 02:32:24.307247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Launched 02:32:24.627543 run osmo-hlr_10.42.42.2(pid=14115): Launched 02:32:24.750523 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:25.307274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Launched 02:32:25.627724 run osmo-stp_10.42.42.5(pid=14118): Launched 02:32:25.750594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:26.302938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Launched 02:32:26.425868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:26.695794 run patchelf(pid=14121): Launched 02:32:26.874688 run osmo-stp_10.42.42.5(pid=14118): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] 02:32:27.010210 run osmo-stp_10.42.42.5(pid=14118): stdout: | (launched: 2022-12-10_02:32:25.569711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:27.147155 run osmo-stp_10.42.42.5(pid=14118): stderr: | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023225763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:27.284039 run osmo-stp_10.42.42.5(pid=14118): stdout: | (launched: 2022-12-10_02:32:25.569711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:27.415526 run osmo-stp_10.42.42.5(pid=14118): stderr: | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023225762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023225763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023225765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:27.571527 run patchelf(pid=14121): Terminating (SIGINT) 02:32:27.750921 run patchelf(pid=14121): Terminated: ok {rc=0} 02:32:27.880419 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14118): Process ended prematurely: osmo-stp_10.42.42.5(pid=14118) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 02:32:27.889822 tst ping.py:22: Test FAILED (6.6 sec) 02:32:27.918132 run osmo-hlr_10.42.42.2(pid=14115): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14115)] 02:32:27.968511 run osmo-hlr_10.42.42.2(pid=14115): stdout: | (launched: 2022-12-10_02:32:24.569349) 02:32:28.020898 run osmo-hlr_10.42.42.2(pid=14115): stderr: | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023224766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023224779 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023224789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023224789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023224790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:28.073812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Terminating (SIGTERM) 02:32:28.115951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Terminating (SIGTERM) 02:32:28.158210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Terminating (SIGTERM) 02:32:28.200662 --- ParallelTerminationStrategy: PID 14114 died... 02:32:28.221106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Terminated: ok {rc=0} 02:32:28.267885 --- ParallelTerminationStrategy: PID 14117 died... 02:32:28.287788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Terminated: ok {rc=0} 02:32:28.334194 --- ParallelTerminationStrategy: PID 14120 died... 02:32:28.353925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Terminated: ok {rc=0} 02:32:28.442293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:32:29.530806 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:29.542736 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:29.614617 tst ping_idle_ping.py: using LAC 25374 02:32:29.734004 tst ping_idle_ping.py: using RAC 129 02:32:29.854267 tst ping_idle_ping.py: using CellId 25374 02:32:29.973053 tst ping_idle_ping.py: using BVCI 25375 02:32:30.091399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.102943 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.114179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.125633 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.136666 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.147922 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.159262 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:30.170440 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:30.292806 tst ping_idle_ping.py:24: start network... 02:32:30.510591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:31.035430 run create_hlr_db(pid=14122): Launched 02:32:31.196534 bus /gobi_6: Setting Powered False 02:32:32.263678 run create_hlr_db(pid=14122): Terminated: ok {rc=0} 02:32:32.705827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14124): Launched 02:32:33.025485 run osmo-hlr_10.42.42.2(pid=14125): Launched 02:32:33.148182 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:33.699953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14127): Launched 02:32:34.020580 run osmo-stp_10.42.42.5(pid=14128): Launched 02:32:34.143295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:34.694169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14130): Launched 02:32:34.817404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:35.086889 run patchelf(pid=14131): Launched 02:32:35.266114 run osmo-stp_10.42.42.5(pid=14128): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14128)] 02:32:35.401469 run osmo-stp_10.42.42.5(pid=14128): stdout: | (launched: 2022-12-10_02:32:33.961874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:35.538946 run osmo-stp_10.42.42.5(pid=14128): stderr: | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023234154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:35.676005 run osmo-stp_10.42.42.5(pid=14128): stdout: | (launched: 2022-12-10_02:32:33.961874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:35.807292 run osmo-stp_10.42.42.5(pid=14128): stderr: | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023234153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023234154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023234154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:35.963271 run patchelf(pid=14131): Terminating (SIGINT) 02:32:36.142509 run patchelf(pid=14131): Terminated: ok {rc=0} 02:32:36.271361 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14128): Process ended prematurely: osmo-stp_10.42.42.5(pid=14128) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14128)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:32:36.280717 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:32:36.308734 run osmo-hlr_10.42.42.2(pid=14125): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14125)] 02:32:36.359057 run osmo-hlr_10.42.42.2(pid=14125): stdout: | (launched: 2022-12-10_02:32:32.967818) 02:32:36.411133 run osmo-hlr_10.42.42.2(pid=14125): stderr: | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023233167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023233179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023233188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023233188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023233188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:36.463692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14124): Terminating (SIGTERM) 02:32:36.505641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14127): Terminating (SIGTERM) 02:32:36.547721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14130): Terminating (SIGTERM) 02:32:36.589938 --- ParallelTerminationStrategy: PID 14124 died... 02:32:36.610006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14124): Terminated: ok {rc=0} 02:32:36.656328 --- ParallelTerminationStrategy: PID 14127 died... 02:32:36.675842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14127): Terminated: ok {rc=0} 02:32:36.721778 --- ParallelTerminationStrategy: PID 14130 died... 02:32:36.741364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14130): Terminated: ok {rc=0} 02:32:36.830124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:32:38.139829 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:32:38.146687 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:32:38.180914 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:32:38.220384 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:32:38.309928 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:32:38.342905 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:32:38.381477 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:32:38.979575 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:32:39.031557 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.042847 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:32:39.114653 tst cs_paging_gprs_active.py: using LAC 25375 02:32:39.243692 tst cs_paging_gprs_active.py: using RAC 130 02:32:39.375105 tst cs_paging_gprs_active.py: using CellId 25375 02:32:39.502464 tst cs_paging_gprs_active.py: using BVCI 25376 02:32:39.620666 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.631975 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.643111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.654254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.665358 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.676413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.687709 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.698815 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:39.710031 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:32:39.827480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:32:39.945493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:32:40.150732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:40.456609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14139): Launched 02:32:40.721943 run iperf3-srv_10.42.42.10(pid=14140): Launched 02:32:40.837557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:32:41.041591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:41.347371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14141): Launched 02:32:41.613738 run iperf3-srv_10.42.42.10(pid=14142): Launched 02:32:41.729102 tst cs_paging_gprs_active.py:38: start network... 02:32:41.933169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:42.406579 run create_hlr_db(pid=14143): Launched 02:32:42.524869 bus /gobi_6: Setting Powered False 02:32:43.586119 run create_hlr_db(pid=14143): Terminated: ok {rc=0} 02:32:44.030192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Launched 02:32:44.357246 run osmo-hlr_10.42.42.2(pid=14146): Launched 02:32:44.482541 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:45.043745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Launched 02:32:45.369709 run osmo-stp_10.42.42.5(pid=14149): Launched 02:32:45.495531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:46.075026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Launched 02:32:46.237453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:46.536101 run patchelf(pid=14152): Launched 02:32:46.731862 run osmo-stp_10.42.42.5(pid=14149): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] 02:32:46.872648 run osmo-stp_10.42.42.5(pid=14149): stdout: | (launched: 2022-12-10_02:32:45.310440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:47.014390 run osmo-stp_10.42.42.5(pid=14149): stderr: | [0;m[38;5;43m20221210023245502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023245502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023245503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023245503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023245505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023245506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023245506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:47.156335 run osmo-stp_10.42.42.5(pid=14149): stdout: | (launched: 2022-12-10_02:32:45.310440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:47.291554 run osmo-stp_10.42.42.5(pid=14149): stderr: | [0;m[38;5;43m20221210023245502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023245502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023245503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023245503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023245505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023245506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023245506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:47.450062 run patchelf(pid=14152): Terminating (SIGINT) 02:32:47.632937 run patchelf(pid=14152): Terminated: ok {rc=0} 02:32:47.764884 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14149): Process ended prematurely: osmo-stp_10.42.42.5(pid=14149) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:32:47.775417 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:32:47.803892 run osmo-hlr_10.42.42.2(pid=14146): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14146)] 02:32:47.854432 run osmo-hlr_10.42.42.2(pid=14146): stdout: | (launched: 2022-12-10_02:32:44.297692) 02:32:47.906347 run osmo-hlr_10.42.42.2(pid=14146): stderr: | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023244497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023244511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023244519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023244519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023244519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:47.959667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14139): Terminating (SIGTERM) 02:32:48.001324 run iperf3-srv_10.42.42.10(pid=14140): Terminating (SIGTERM) 02:32:48.042930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14141): Terminating (SIGTERM) 02:32:48.084636 run iperf3-srv_10.42.42.10(pid=14142): Terminating (SIGTERM) 02:32:48.126248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Terminating (SIGTERM) 02:32:48.167940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Terminating (SIGTERM) 02:32:48.209880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Terminating (SIGTERM) 02:32:48.251687 --- ParallelTerminationStrategy: PID 14139 died... 02:32:48.271627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14139): Terminated: ok {rc=0} 02:32:48.317692 --- ParallelTerminationStrategy: PID 14140 died... 02:32:48.337237 run iperf3-srv_10.42.42.10(pid=14140): Terminated {rc=256} 02:32:48.382965 --- ParallelTerminationStrategy: PID 14141 died... 02:32:48.402538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14141): Terminated: ok {rc=0} 02:32:48.448793 --- ParallelTerminationStrategy: PID 14142 died... 02:32:48.468594 run iperf3-srv_10.42.42.10(pid=14142): Terminated {rc=256} 02:32:48.514366 --- ParallelTerminationStrategy: PID 14145 died... 02:32:48.536617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Terminated: ok {rc=0} 02:32:48.589154 --- ParallelTerminationStrategy: PID 14148 died... 02:32:48.614005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Terminated: ok {rc=0} 02:32:48.663012 --- ParallelTerminationStrategy: PID 14151 died... 02:32:48.681715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Terminated: ok {rc=0} 02:32:48.774678 bus /gobi_0: Setting Powered False 02:32:49.874735 bus /gobi_0: Setting Powered False 02:32:50.992764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:32:52.143234 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.155203 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:32:52.229459 tst iperf3.py: using LAC 25376 02:32:52.358572 tst iperf3.py: using RAC 131 02:32:52.486685 tst iperf3.py: using CellId 25376 02:32:52.614420 tst iperf3.py: using BVCI 25377 02:32:52.731976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.743310 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.754414 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.765575 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.776901 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.788602 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.799936 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.810970 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:52.822253 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:32:52.939643 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:53.144417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:53.449452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Launched 02:32:53.716370 run iperf3-srv_10.42.42.10(pid=14156): Launched 02:32:53.831630 tst iperf3.py:8: start network... 02:32:54.034206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:54.504860 run create_hlr_db(pid=14157): Launched 02:32:54.622355 bus /gobi_6: Setting Powered False 02:32:55.682326 run create_hlr_db(pid=14157): Terminated: ok {rc=0} 02:32:56.124218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Launched 02:32:56.448677 run osmo-hlr_10.42.42.2(pid=14160): Launched 02:32:56.574818 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:57.141229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Launched 02:32:57.466484 run osmo-stp_10.42.42.5(pid=14163): Launched 02:32:57.591708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:58.154652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Launched 02:32:58.279653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:58.553547 run patchelf(pid=14166): Launched 02:32:58.735638 run osmo-stp_10.42.42.5(pid=14163): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] 02:32:58.874014 run osmo-stp_10.42.42.5(pid=14163): stdout: | (launched: 2022-12-10_02:32:57.407238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:59.012776 run osmo-stp_10.42.42.5(pid=14163): stderr: | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023257604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:59.151818 run osmo-stp_10.42.42.5(pid=14163): stdout: | (launched: 2022-12-10_02:32:57.407238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:59.285408 run osmo-stp_10.42.42.5(pid=14163): stderr: | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023257603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023257604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023257604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:59.443954 run patchelf(pid=14166): Terminating (SIGINT) 02:32:59.627147 run patchelf(pid=14166): Terminated: ok {rc=0} 02:32:59.758633 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14163): Process ended prematurely: osmo-stp_10.42.42.5(pid=14163) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 02:32:59.768626 tst iperf3.py:8: Test FAILED (7.7 sec) 02:32:59.797472 run osmo-hlr_10.42.42.2(pid=14160): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14160)] 02:32:59.847773 run osmo-hlr_10.42.42.2(pid=14160): stdout: | (launched: 2022-12-10_02:32:56.389996) 02:32:59.899791 run osmo-hlr_10.42.42.2(pid=14160): stderr: | [0;m[1;31m20221210023256590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023256591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023256591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023256591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023256591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023256591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023256603 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023256611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023256612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023256612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:59.952264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminating (SIGTERM) 02:32:59.994087 run iperf3-srv_10.42.42.10(pid=14156): Terminating (SIGTERM) 02:33:00.035900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Terminating (SIGTERM) 02:33:00.077859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Terminating (SIGTERM) 02:33:00.119585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Terminating (SIGTERM) 02:33:00.161418 --- ParallelTerminationStrategy: PID 14155 died... 02:33:00.181402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminated: ok {rc=0} 02:33:00.227751 --- ParallelTerminationStrategy: PID 14156 died... 02:33:00.247324 run iperf3-srv_10.42.42.10(pid=14156): Terminated {rc=256} 02:33:00.293207 --- ParallelTerminationStrategy: PID 14159 died... 02:33:00.312808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Terminated: ok {rc=0} 02:33:00.358851 --- ParallelTerminationStrategy: PID 14162 died... 02:33:00.378452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Terminated: ok {rc=0} 02:33:00.424325 --- ParallelTerminationStrategy: PID 14165 died... 02:33:00.443986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Terminated: ok {rc=0} 02:33:00.531208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:33:01.702392 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:01.718915 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:01.807178 tst iperf3m4.py: using LAC 25377 02:33:01.966027 tst iperf3m4.py: using RAC 132 02:33:02.123526 tst iperf3m4.py: using CellId 25377 02:33:02.249645 tst iperf3m4.py: using BVCI 25378 02:33:02.371074 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.382651 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.394041 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.405487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.416856 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.428284 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.439896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.451146 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:02.462802 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:02.578911 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:02.702066 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:02.819109 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:02.941189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:03.162623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:03.489924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Launched 02:33:03.774325 run iperf3-srv_10.42.42.10(pid=14169): Launched 02:33:03.897840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:33:04.117898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:04.444610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Launched 02:33:04.728060 run iperf3-srv_10.42.42.10(pid=14171): Launched 02:33:04.851429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:33:05.071000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:05.398038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14172): Launched 02:33:05.681744 run iperf3-srv_10.42.42.10(pid=14173): Launched 02:33:05.805779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:33:06.026279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:06.354840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14174): Launched 02:33:06.638332 run iperf3-srv_10.42.42.10(pid=14175): Launched 02:33:06.761277 tst iperf3m4.py:8: start network... 02:33:06.980579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:07.485697 run create_hlr_db(pid=14176): Launched 02:33:07.618098 bus /gobi_6: Setting Powered False 02:33:08.682357 run create_hlr_db(pid=14176): Terminated: ok {rc=0} 02:33:09.117071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Launched 02:33:09.421562 run osmo-hlr_10.42.42.2(pid=14179): Launched 02:33:09.538997 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:10.075740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Launched 02:33:10.380442 run osmo-stp_10.42.42.5(pid=14182): Launched 02:33:10.498573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:11.023482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14184): Launched 02:33:11.140331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:11.397212 run patchelf(pid=14185): Launched 02:33:11.567232 run osmo-stp_10.42.42.5(pid=14182): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] 02:33:11.695955 run osmo-stp_10.42.42.5(pid=14182): stdout: | (launched: 2022-12-10_02:33:10.324609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:11.826542 run osmo-stp_10.42.42.5(pid=14182): stderr: | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023310496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:11.956599 run osmo-stp_10.42.42.5(pid=14182): stdout: | (launched: 2022-12-10_02:33:10.324609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:12.081465 run osmo-stp_10.42.42.5(pid=14182): stderr: | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023310495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023310496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023310496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:12.229547 run patchelf(pid=14185): Terminating (SIGINT) 02:33:12.400490 run patchelf(pid=14185): Terminated: ok {rc=0} 02:33:12.523383 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14182): Process ended prematurely: osmo-stp_10.42.42.5(pid=14182) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:33:12.532901 tst iperf3m4.py:8: Test FAILED (10.9 sec) 02:33:12.560754 run osmo-hlr_10.42.42.2(pid=14179): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14179)] 02:33:12.609051 run osmo-hlr_10.42.42.2(pid=14179): stdout: | (launched: 2022-12-10_02:33:09.366139) 02:33:12.658924 run osmo-hlr_10.42.42.2(pid=14179): stderr: | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023309543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023309555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023309564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023309564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023309565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:12.709340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Terminating (SIGTERM) 02:33:12.749825 run iperf3-srv_10.42.42.10(pid=14169): Terminating (SIGTERM) 02:33:12.789681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Terminating (SIGTERM) 02:33:12.830869 run iperf3-srv_10.42.42.10(pid=14171): Terminating (SIGTERM) 02:33:12.871044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14172): Terminating (SIGTERM) 02:33:12.911499 run iperf3-srv_10.42.42.10(pid=14173): Terminating (SIGTERM) 02:33:12.951650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14174): Terminating (SIGTERM) 02:33:12.992079 run iperf3-srv_10.42.42.10(pid=14175): Terminating (SIGTERM) 02:33:13.032217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Terminating (SIGTERM) 02:33:13.073215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Terminating (SIGTERM) 02:33:13.114122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14184): Terminating (SIGTERM) 02:33:13.154756 --- ParallelTerminationStrategy: PID 14168 died... 02:33:13.174065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Terminated: ok {rc=0} 02:33:13.218876 --- ParallelTerminationStrategy: PID 14169 died... 02:33:13.237718 run iperf3-srv_10.42.42.10(pid=14169): Terminated {rc=256} 02:33:13.282220 --- ParallelTerminationStrategy: PID 14170 died... 02:33:13.301021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Terminated: ok {rc=0} 02:33:13.345820 --- ParallelTerminationStrategy: PID 14171 died... 02:33:13.364494 run iperf3-srv_10.42.42.10(pid=14171): Terminated {rc=256} 02:33:13.408831 --- ParallelTerminationStrategy: PID 14172 died... 02:33:13.428021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14172): Terminated: ok {rc=0} 02:33:13.473353 --- ParallelTerminationStrategy: PID 14173 died... 02:33:13.491886 run iperf3-srv_10.42.42.10(pid=14173): Terminated {rc=256} 02:33:13.536498 --- ParallelTerminationStrategy: PID 14174 died... 02:33:13.555191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14174): Terminated: ok {rc=0} 02:33:13.599897 --- ParallelTerminationStrategy: PID 14175 died... 02:33:13.618702 run iperf3-srv_10.42.42.10(pid=14175): Terminated {rc=256} 02:33:13.663414 --- ParallelTerminationStrategy: PID 14178 died... 02:33:13.682266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14178): Terminated: ok {rc=0} 02:33:13.726857 --- ParallelTerminationStrategy: PID 14181 died... 02:33:13.745925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14181): Terminated: ok {rc=0} 02:33:13.791259 --- ParallelTerminationStrategy: PID 14184 died... 02:33:13.810215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14184): Terminated: ok {rc=0} 02:33:13.897233 bus /gobi_4: Setting Powered False 02:33:14.997982 bus /gobi_4: Setting Powered False 02:33:16.114079 bus /gobi_1: Setting Powered False 02:33:17.222105 bus /gobi_1: Setting Powered False 02:33:18.339484 bus /gobi_0: Setting Powered False 02:33:19.438784 bus /gobi_0: Setting Powered False 02:33:20.556653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:33:21.658574 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:21.670267 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:21.739854 tst ping.py: using LAC 25378 02:33:21.857617 tst ping.py: using RAC 133 02:33:21.985101 tst ping.py: using CellId 25378 02:33:22.110826 tst ping.py: using BVCI 25379 02:33:22.227157 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.238756 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.250111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.261452 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.272525 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.283711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.294948 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:22.306115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:22.421650 tst ping.py:19: start network... 02:33:22.621335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:23.082192 run create_hlr_db(pid=14187): Launched 02:33:23.196878 bus /gobi_6: Setting Powered False 02:33:24.256726 run create_hlr_db(pid=14187): Terminated: ok {rc=0} 02:33:24.695610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Launched 02:33:25.015815 run osmo-hlr_10.42.42.2(pid=14190): Launched 02:33:25.138077 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:25.694715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Launched 02:33:26.013693 run osmo-stp_10.42.42.5(pid=14193): Launched 02:33:26.135391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:26.687378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Launched 02:33:26.810184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:27.079277 run patchelf(pid=14196): Launched 02:33:27.257299 run osmo-stp_10.42.42.5(pid=14193): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] 02:33:27.392147 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-10_02:33:25.956154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:27.528720 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023326148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:27.665301 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-10_02:33:25.956154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:27.795912 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023326148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023326148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023326149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:27.951265 run patchelf(pid=14196): Terminating (SIGINT) 02:33:28.130427 run patchelf(pid=14196): Terminated: ok {rc=0} 02:33:28.258956 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 02:33:28.268157 tst ping.py:22: Test FAILED (6.6 sec) 02:33:28.296010 run osmo-hlr_10.42.42.2(pid=14190): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14190)] 02:33:28.345783 run osmo-hlr_10.42.42.2(pid=14190): stdout: | (launched: 2022-12-10_02:33:24.957936) 02:33:28.397305 run osmo-hlr_10.42.42.2(pid=14190): stderr: | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023325159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023325172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023325182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023325183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023325183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:28.449447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminating (SIGTERM) 02:33:28.491077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminating (SIGTERM) 02:33:28.532759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminating (SIGTERM) 02:33:28.575293 --- ParallelTerminationStrategy: PID 14189 died... 02:33:28.595264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminated: ok {rc=0} 02:33:28.641149 --- ParallelTerminationStrategy: PID 14192 died... 02:33:28.660622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminated: ok {rc=0} 02:33:28.706876 --- ParallelTerminationStrategy: PID 14195 died... 02:33:28.726389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminated: ok {rc=0} 02:33:28.813361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:33:29.901140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:29.913198 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:29.984606 tst ping_idle_ping.py: using LAC 25379 02:33:30.101374 tst ping_idle_ping.py: using RAC 134 02:33:30.218005 tst ping_idle_ping.py: using CellId 25379 02:33:30.336620 tst ping_idle_ping.py: using BVCI 25380 02:33:30.444700 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.455644 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.466346 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.477363 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.488048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.498858 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.509996 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:30.520755 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:30.635773 tst ping_idle_ping.py:24: start network... 02:33:30.846462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:31.383526 run create_hlr_db(pid=14197): Launched 02:33:31.543511 bus /gobi_6: Setting Powered False 02:33:32.603884 run create_hlr_db(pid=14197): Terminated: ok {rc=0} 02:33:33.057337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Launched 02:33:33.376313 run osmo-hlr_10.42.42.2(pid=14200): Launched 02:33:33.498693 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:34.050940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Launched 02:33:34.371326 run osmo-stp_10.42.42.5(pid=14203): Launched 02:33:34.493490 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:35.045851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Launched 02:33:35.169241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:35.439661 run patchelf(pid=14206): Launched 02:33:35.618732 run osmo-stp_10.42.42.5(pid=14203): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] 02:33:35.754049 run osmo-stp_10.42.42.5(pid=14203): stdout: | (launched: 2022-12-10_02:33:34.313314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:35.891873 run osmo-stp_10.42.42.5(pid=14203): stderr: | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023334504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:36.030058 run osmo-stp_10.42.42.5(pid=14203): stdout: | (launched: 2022-12-10_02:33:34.313314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:36.161371 run osmo-stp_10.42.42.5(pid=14203): stderr: | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023334503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023334504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023334506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:36.317177 run patchelf(pid=14206): Terminating (SIGINT) 02:33:36.496798 run patchelf(pid=14206): Terminated: ok {rc=0} 02:33:36.625848 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14203): Process ended prematurely: osmo-stp_10.42.42.5(pid=14203) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:33:36.635134 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:33:36.663043 run osmo-hlr_10.42.42.2(pid=14200): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14200)] 02:33:36.712737 run osmo-hlr_10.42.42.2(pid=14200): stdout: | (launched: 2022-12-10_02:33:33.318546) 02:33:36.764156 run osmo-hlr_10.42.42.2(pid=14200): stderr: | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023333518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023333531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023333539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023333539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023333539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:36.816490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Terminating (SIGTERM) 02:33:36.858133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Terminating (SIGTERM) 02:33:36.899554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Terminating (SIGTERM) 02:33:36.941147 --- ParallelTerminationStrategy: PID 14199 died... 02:33:36.960893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Terminated: ok {rc=0} 02:33:37.006557 --- ParallelTerminationStrategy: PID 14202 died... 02:33:37.026084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Terminated: ok {rc=0} 02:33:37.071994 --- ParallelTerminationStrategy: PID 14205 died... 02:33:37.091647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Terminated: ok {rc=0} 02:33:37.179514 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:33:38.492421 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:33:38.499535 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:33:38.534533 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:33:38.573686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:33:38.660663 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:33:38.694484 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:33:38.733954 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:33:39.335338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:33:39.385891 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:39.397392 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:33:39.449094 tst cs_paging_gprs_active.py: using LAC 25380 02:33:39.569639 tst cs_paging_gprs_active.py: using RAC 135 02:33:39.697977 tst cs_paging_gprs_active.py: using CellId 25380 02:33:39.824828 tst cs_paging_gprs_active.py: using BVCI 25381 02:33:39.943547 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:39.956585 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:39.968509 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:39.980625 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:39.992389 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:40.004524 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:40.016342 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:40.027947 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:40.039801 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:33:40.158286 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:33:40.279893 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:33:40.501055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:40.828870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14210): Launched 02:33:41.113267 run iperf3-srv_10.42.42.10(pid=14211): Launched 02:33:41.236707 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:33:41.456433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:41.783550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14212): Launched 02:33:42.070184 run iperf3-srv_10.42.42.10(pid=14213): Launched 02:33:42.193982 tst cs_paging_gprs_active.py:38: start network... 02:33:42.413516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:42.919493 run create_hlr_db(pid=14214): Launched 02:33:43.052762 bus /gobi_6: Setting Powered False 02:33:44.117544 run create_hlr_db(pid=14214): Terminated: ok {rc=0} 02:33:44.569724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Launched 02:33:44.895194 run osmo-hlr_10.42.42.2(pid=14217): Launched 02:33:45.020374 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:45.578951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Launched 02:33:45.922871 run osmo-stp_10.42.42.5(pid=14220): Launched 02:33:46.113555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:46.807469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Launched 02:33:46.940498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:47.209710 run patchelf(pid=14223): Launched 02:33:47.396687 run osmo-stp_10.42.42.5(pid=14220): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] 02:33:47.528182 run osmo-stp_10.42.42.5(pid=14220): stdout: | (launched: 2022-12-10_02:33:45.856417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:47.659059 run osmo-stp_10.42.42.5(pid=14220): stderr: | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023346195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:47.789735 run osmo-stp_10.42.42.5(pid=14220): stdout: | (launched: 2022-12-10_02:33:45.856417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:47.914900 run osmo-stp_10.42.42.5(pid=14220): stderr: | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023346194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023346195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023346195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:48.064107 run patchelf(pid=14223): Terminating (SIGINT) 02:33:48.235201 run patchelf(pid=14223): Terminated: ok {rc=0} 02:33:48.358408 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14220): Process ended prematurely: osmo-stp_10.42.42.5(pid=14220) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:33:48.367753 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 02:33:48.395815 run osmo-hlr_10.42.42.2(pid=14217): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14217)] 02:33:48.444584 run osmo-hlr_10.42.42.2(pid=14217): stdout: | (launched: 2022-12-10_02:33:44.835979) 02:33:48.494750 run osmo-hlr_10.42.42.2(pid=14217): stderr: | [0;m[1;31m20221210023345035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023345035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023345036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023345036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023345036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023345036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023345047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023345055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023345056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023345056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:48.545374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14210): Terminating (SIGTERM) 02:33:48.585842 run iperf3-srv_10.42.42.10(pid=14211): Terminating (SIGTERM) 02:33:48.626635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14212): Terminating (SIGTERM) 02:33:48.667133 run iperf3-srv_10.42.42.10(pid=14213): Terminating (SIGTERM) 02:33:48.707476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Terminating (SIGTERM) 02:33:48.747775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Terminating (SIGTERM) 02:33:48.788010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Terminating (SIGTERM) 02:33:48.828618 --- ParallelTerminationStrategy: PID 14210 died... 02:33:48.848026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14210): Terminated: ok {rc=0} 02:33:48.892901 --- ParallelTerminationStrategy: PID 14211 died... 02:33:48.912010 run iperf3-srv_10.42.42.10(pid=14211): Terminated {rc=256} 02:33:48.956526 --- ParallelTerminationStrategy: PID 14212 died... 02:33:48.975505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14212): Terminated: ok {rc=0} 02:33:49.020092 --- ParallelTerminationStrategy: PID 14213 died... 02:33:49.038788 run iperf3-srv_10.42.42.10(pid=14213): Terminated {rc=256} 02:33:49.083427 --- ParallelTerminationStrategy: PID 14216 died... 02:33:49.102395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Terminated: ok {rc=0} 02:33:49.147293 --- ParallelTerminationStrategy: PID 14219 died... 02:33:49.166135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Terminated: ok {rc=0} 02:33:49.211443 --- ParallelTerminationStrategy: PID 14222 died... 02:33:49.230425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Terminated: ok {rc=0} 02:33:49.315918 bus /gobi_0: Setting Powered False 02:33:50.415097 bus /gobi_0: Setting Powered False 02:33:51.534669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:33:52.681419 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:52.693208 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:33:52.751406 tst iperf3.py: using LAC 25381 02:33:52.870200 tst iperf3.py: using RAC 136 02:33:52.990051 tst iperf3.py: using CellId 25381 02:33:53.109919 tst iperf3.py: using BVCI 25382 02:33:53.222917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.234223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.245372 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.256602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.267843 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.279003 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.290422 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.301519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.313409 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:33:53.427621 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:53.632095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:53.937715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14224): Launched 02:33:54.203710 run iperf3-srv_10.42.42.10(pid=14225): Launched 02:33:54.318682 tst iperf3.py:8: start network... 02:33:54.521770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:54.991319 run create_hlr_db(pid=14226): Launched 02:33:55.107681 bus /gobi_6: Setting Powered False 02:33:56.167805 run create_hlr_db(pid=14226): Terminated: ok {rc=0} 02:33:56.610772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14228): Launched 02:33:56.937064 run osmo-hlr_10.42.42.2(pid=14229): Launched 02:33:57.061861 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:57.624330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14231): Launched 02:33:57.949735 run osmo-stp_10.42.42.5(pid=14232): Launched 02:33:58.074034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:58.635398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14234): Launched 02:33:58.759982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:59.034578 run patchelf(pid=14235): Launched 02:33:59.215847 run osmo-stp_10.42.42.5(pid=14232): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14232)] 02:33:59.353495 run osmo-stp_10.42.42.5(pid=14232): stdout: | (launched: 2022-12-10_02:33:57.890956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:59.492019 run osmo-stp_10.42.42.5(pid=14232): stderr: | [0;m[38;5;43m20221210023358084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023358085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023358085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023358085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:59.632599 run osmo-stp_10.42.42.5(pid=14232): stdout: | (launched: 2022-12-10_02:33:57.890956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:59.766259 run osmo-stp_10.42.42.5(pid=14232): stderr: | [0;m[38;5;43m20221210023358084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023358085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023358085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023358085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023358086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:59.924604 run patchelf(pid=14235): Terminating (SIGINT) 02:34:00.107504 run patchelf(pid=14235): Terminated: ok {rc=0} 02:34:00.238888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14232): Process ended prematurely: osmo-stp_10.42.42.5(pid=14232) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14232)] [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:34:00.248829 tst iperf3.py:8: Test FAILED (7.6 sec) 02:34:00.277361 run osmo-hlr_10.42.42.2(pid=14229): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14229)] 02:34:00.327139 run osmo-hlr_10.42.42.2(pid=14229): stdout: | (launched: 2022-12-10_02:33:56.877695) 02:34:00.378550 run osmo-hlr_10.42.42.2(pid=14229): stderr: | [0;m[1;31m20221210023357077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023357077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023357077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023357077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023357077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023357078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023357091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023357099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023357099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023357099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:00.430359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14224): Terminating (SIGTERM) 02:34:00.472007 run iperf3-srv_10.42.42.10(pid=14225): Terminating (SIGTERM) 02:34:00.513898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14228): Terminating (SIGTERM) 02:34:00.555866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14231): Terminating (SIGTERM) 02:34:00.597961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14234): Terminating (SIGTERM) 02:34:00.639978 --- ParallelTerminationStrategy: PID 14224 died... 02:34:00.660014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14224): Terminated: ok {rc=0} 02:34:00.706273 --- ParallelTerminationStrategy: PID 14225 died... 02:34:00.725800 run iperf3-srv_10.42.42.10(pid=14225): Terminated {rc=256} 02:34:00.771696 --- ParallelTerminationStrategy: PID 14228 died... 02:34:00.791328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14228): Terminated: ok {rc=0} 02:34:00.853374 --- ParallelTerminationStrategy: PID 14231 died... 02:34:00.876598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14231): Terminated: ok {rc=0} 02:34:00.934462 --- ParallelTerminationStrategy: PID 14234 died... 02:34:00.954188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14234): Terminated: ok {rc=0} 02:34:01.041779 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:34:02.192728 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.206059 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:02.260381 tst iperf3m4.py: using LAC 25382 02:34:02.388687 tst iperf3m4.py: using RAC 137 02:34:02.516282 tst iperf3m4.py: using CellId 25382 02:34:02.646771 tst iperf3m4.py: using BVCI 25383 02:34:02.766429 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.778469 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.790168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.801749 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.813673 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.825543 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.837392 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.848680 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:02.860516 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:02.981605 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:03.103054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:03.223750 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:03.341973 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:34:03.547737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:03.854381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14236): Launched 02:34:04.120844 run iperf3-srv_10.42.42.10(pid=14237): Launched 02:34:04.236528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:34:04.440108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:04.745080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14238): Launched 02:34:05.010759 run iperf3-srv_10.42.42.10(pid=14239): Launched 02:34:05.125695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:34:05.329247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:05.634236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14240): Launched 02:34:05.899743 run iperf3-srv_10.42.42.10(pid=14241): Launched 02:34:06.014987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:34:06.219028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:06.524033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14242): Launched 02:34:06.789684 run iperf3-srv_10.42.42.10(pid=14243): Launched 02:34:06.904808 tst iperf3m4.py:8: start network... 02:34:07.108479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:07.580011 run create_hlr_db(pid=14244): Launched 02:34:07.697555 bus /gobi_6: Setting Powered False 02:34:08.758340 run create_hlr_db(pid=14244): Terminated: ok {rc=0} 02:34:09.181622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Launched 02:34:09.487322 run osmo-hlr_10.42.42.2(pid=14247): Launched 02:34:09.605275 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:10.133174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Launched 02:34:10.437744 run osmo-stp_10.42.42.5(pid=14250): Launched 02:34:10.554464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:11.079434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14252): Launched 02:34:11.197085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:11.453060 run patchelf(pid=14253): Launched 02:34:11.622982 run osmo-stp_10.42.42.5(pid=14250): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] 02:34:11.751111 run osmo-stp_10.42.42.5(pid=14250): stdout: | (launched: 2022-12-10_02:34:10.382155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:11.881269 run osmo-stp_10.42.42.5(pid=14250): stderr: | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023410553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:12.011679 run osmo-stp_10.42.42.5(pid=14250): stdout: | (launched: 2022-12-10_02:34:10.382155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:12.136653 run osmo-stp_10.42.42.5(pid=14250): stderr: | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023410552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023410553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023410555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:12.285625 run patchelf(pid=14253): Terminating (SIGINT) 02:34:12.457402 run patchelf(pid=14253): Terminated: ok {rc=0} 02:34:12.580855 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14250): Process ended prematurely: osmo-stp_10.42.42.5(pid=14250) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:34:12.590666 tst iperf3m4.py:8: Test FAILED (10.4 sec) 02:34:12.618850 run osmo-hlr_10.42.42.2(pid=14247): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14247)] 02:34:12.666748 run osmo-hlr_10.42.42.2(pid=14247): stdout: | (launched: 2022-12-10_02:34:09.431375) 02:34:12.716637 run osmo-hlr_10.42.42.2(pid=14247): stderr: | [0;m[1;31m20221210023409608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023409609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023409609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023409609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023409609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023409609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023409631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023409641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023409641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023409641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:12.766745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14236): Terminating (SIGTERM) 02:34:12.806656 run iperf3-srv_10.42.42.10(pid=14237): Terminating (SIGTERM) 02:34:12.846820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14238): Terminating (SIGTERM) 02:34:12.886906 run iperf3-srv_10.42.42.10(pid=14239): Terminating (SIGTERM) 02:34:12.926931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14240): Terminating (SIGTERM) 02:34:12.966929 run iperf3-srv_10.42.42.10(pid=14241): Terminating (SIGTERM) 02:34:13.006919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14242): Terminating (SIGTERM) 02:34:13.047099 run iperf3-srv_10.42.42.10(pid=14243): Terminating (SIGTERM) 02:34:13.087217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Terminating (SIGTERM) 02:34:13.127529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Terminating (SIGTERM) 02:34:13.167576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14252): Terminating (SIGTERM) 02:34:13.208011 --- ParallelTerminationStrategy: PID 14236 died... 02:34:13.227171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14236): Terminated: ok {rc=0} 02:34:13.271523 --- ParallelTerminationStrategy: PID 14237 died... 02:34:13.290127 run iperf3-srv_10.42.42.10(pid=14237): Terminated {rc=256} 02:34:13.334481 --- ParallelTerminationStrategy: PID 14238 died... 02:34:13.353293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14238): Terminated: ok {rc=0} 02:34:13.397647 --- ParallelTerminationStrategy: PID 14239 died... 02:34:13.416183 run iperf3-srv_10.42.42.10(pid=14239): Terminated {rc=256} 02:34:13.460559 --- ParallelTerminationStrategy: PID 14240 died... 02:34:13.479261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14240): Terminated: ok {rc=0} 02:34:13.523511 --- ParallelTerminationStrategy: PID 14241 died... 02:34:13.542076 run iperf3-srv_10.42.42.10(pid=14241): Terminated {rc=256} 02:34:13.586243 --- ParallelTerminationStrategy: PID 14242 died... 02:34:13.604899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14242): Terminated: ok {rc=0} 02:34:13.649610 --- ParallelTerminationStrategy: PID 14243 died... 02:34:13.668172 run iperf3-srv_10.42.42.10(pid=14243): Terminated {rc=256} 02:34:13.712229 --- ParallelTerminationStrategy: PID 14246 died... 02:34:13.730848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14246): Terminated: ok {rc=0} 02:34:13.775806 --- ParallelTerminationStrategy: PID 14249 died... 02:34:13.794533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14249): Terminated: ok {rc=0} 02:34:13.838994 --- ParallelTerminationStrategy: PID 14252 died... 02:34:13.857618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14252): Terminated: ok {rc=0} 02:34:13.943554 bus /gobi_4: Setting Powered False 02:34:15.043650 bus /gobi_4: Setting Powered False 02:34:16.167313 bus /gobi_1: Setting Powered False 02:34:17.274055 bus /gobi_1: Setting Powered False 02:34:18.388143 bus /gobi_0: Setting Powered False 02:34:19.485231 bus /gobi_0: Setting Powered False 02:34:20.602025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:34:21.705347 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:21.717602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:21.774990 tst ping.py: using LAC 25383 02:34:21.893901 tst ping.py: using RAC 138 02:34:22.011971 tst ping.py: using CellId 25383 02:34:22.127820 tst ping.py: using BVCI 25384 02:34:22.236085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.247424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.258579 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.269874 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.281186 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.293109 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.304717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.316145 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:22.433317 tst ping.py:19: start network... 02:34:22.632696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:23.092440 run create_hlr_db(pid=14254): Launched 02:34:23.206316 bus /gobi_6: Setting Powered False 02:34:24.266351 run create_hlr_db(pid=14254): Terminated: ok {rc=0} 02:34:24.703499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14256): Launched 02:34:25.023699 run osmo-hlr_10.42.42.2(pid=14257): Launched 02:34:25.145911 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:25.699551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14259): Launched 02:34:26.020117 run osmo-stp_10.42.42.5(pid=14260): Launched 02:34:26.142359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:26.695721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14262): Launched 02:34:26.818649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:27.088380 run patchelf(pid=14263): Launched 02:34:27.267023 run osmo-stp_10.42.42.5(pid=14260): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14260)] 02:34:27.402591 run osmo-stp_10.42.42.5(pid=14260): stdout: | (launched: 2022-12-10_02:34:25.962045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:27.539734 run osmo-stp_10.42.42.5(pid=14260): stderr: | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023426156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:27.676860 run osmo-stp_10.42.42.5(pid=14260): stdout: | (launched: 2022-12-10_02:34:25.962045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:27.807624 run osmo-stp_10.42.42.5(pid=14260): stderr: | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023426155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023426156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023426156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:27.963434 run patchelf(pid=14263): Terminating (SIGINT) 02:34:28.142718 run patchelf(pid=14263): Terminated: ok {rc=0} 02:34:28.271665 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14260): Process ended prematurely: osmo-stp_10.42.42.5(pid=14260) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14260)] [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:34:28.281023 tst ping.py:22: Test FAILED (6.6 sec) 02:34:28.309039 run osmo-hlr_10.42.42.2(pid=14257): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14257)] 02:34:28.359341 run osmo-hlr_10.42.42.2(pid=14257): stdout: | (launched: 2022-12-10_02:34:24.965702) 02:34:28.410963 run osmo-hlr_10.42.42.2(pid=14257): stderr: | [0;m[1;31m20221210023425162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023425162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023425162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023425163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023425163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023425163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023425175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023425183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023425184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023425184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:28.463057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14256): Terminating (SIGTERM) 02:34:28.504665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14259): Terminating (SIGTERM) 02:34:28.546545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14262): Terminating (SIGTERM) 02:34:28.589145 --- ParallelTerminationStrategy: PID 14256 died... 02:34:28.609112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14256): Terminated: ok {rc=0} 02:34:28.655201 --- ParallelTerminationStrategy: PID 14259 died... 02:34:28.675076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14259): Terminated: ok {rc=0} 02:34:28.721326 --- ParallelTerminationStrategy: PID 14262 died... 02:34:28.741000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14262): Terminated: ok {rc=0} 02:34:28.828443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:34:29.916368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:29.928782 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:29.984638 tst ping_idle_ping.py: using LAC 25384 02:34:30.111287 tst ping_idle_ping.py: using RAC 139 02:34:30.237381 tst ping_idle_ping.py: using CellId 25384 02:34:30.363368 tst ping_idle_ping.py: using BVCI 25385 02:34:30.475734 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.487460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.498878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.510867 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.522532 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.534234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.546155 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:30.557655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:30.678162 tst ping_idle_ping.py:24: start network... 02:34:30.899709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:31.383265 run create_hlr_db(pid=14264): Launched 02:34:31.533113 bus /gobi_6: Setting Powered False 02:34:32.593541 run create_hlr_db(pid=14264): Terminated: ok {rc=0} 02:34:33.011206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Launched 02:34:33.310107 run osmo-hlr_10.42.42.2(pid=14267): Launched 02:34:33.424871 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:33.954379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Launched 02:34:34.253835 run osmo-stp_10.42.42.5(pid=14270): Launched 02:34:34.368747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:34.884897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14272): Launched 02:34:35.000232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:35.254117 run patchelf(pid=14273): Launched 02:34:35.421957 run osmo-stp_10.42.42.5(pid=14270): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] 02:34:35.549311 run osmo-stp_10.42.42.5(pid=14270): stdout: | (launched: 2022-12-10_02:34:34.199039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:35.678361 run osmo-stp_10.42.42.5(pid=14270): stderr: | [0;m[38;5;43m20221210023434369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023434369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023434370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023434370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:35.807571 run osmo-stp_10.42.42.5(pid=14270): stdout: | (launched: 2022-12-10_02:34:34.199039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:35.931030 run osmo-stp_10.42.42.5(pid=14270): stderr: | [0;m[38;5;43m20221210023434369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023434369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023434370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023434370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023434371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:36.076808 run patchelf(pid=14273): Terminating (SIGINT) 02:34:36.246012 run patchelf(pid=14273): Terminated: ok {rc=0} 02:34:36.367256 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14270): Process ended prematurely: osmo-stp_10.42.42.5(pid=14270) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:34:36.376164 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:34:36.403782 run osmo-hlr_10.42.42.2(pid=14267): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14267)] 02:34:36.452549 run osmo-hlr_10.42.42.2(pid=14267): stdout: | (launched: 2022-12-10_02:34:33.255779) 02:34:36.503005 run osmo-hlr_10.42.42.2(pid=14267): stderr: | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023433429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023433441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023433449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023433450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023433450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:36.553689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminating (SIGTERM) 02:34:36.594252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Terminating (SIGTERM) 02:34:36.634930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14272): Terminating (SIGTERM) 02:34:36.676052 --- ParallelTerminationStrategy: PID 14266 died... 02:34:36.695259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminated: ok {rc=0} 02:34:36.740365 --- ParallelTerminationStrategy: PID 14269 died... 02:34:36.759497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Terminated: ok {rc=0} 02:34:36.804272 --- ParallelTerminationStrategy: PID 14272 died... 02:34:36.823360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14272): Terminated: ok {rc=0} 02:34:36.908013 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:34:38.224368 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:34:38.231997 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:34:38.266839 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:34:38.302219 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:34:38.356617 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:34:38.390660 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:34:38.426497 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:34:38.985933 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:34:38.991188 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.003011 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:34:39.074208 tst switch_tch_pdch.py: using LAC 25385 02:34:39.205550 tst switch_tch_pdch.py: using RAC 140 02:34:39.330604 tst switch_tch_pdch.py: using CellId 25385 02:34:39.455561 tst switch_tch_pdch.py: using BVCI 25386 02:34:39.571967 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.583708 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.595252 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.606815 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.618302 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.629889 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.641610 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:39.652893 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:34:39.770950 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:34:39.885469 tst switch_tch_pdch.py:51: start network... 02:34:40.085419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:40.547329 run create_hlr_db(pid=14278): Launched 02:34:40.663537 bus /gobi_6: Setting Powered False 02:34:41.722797 run create_hlr_db(pid=14278): Terminated: ok {rc=0} 02:34:42.160076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Launched 02:34:42.479583 run osmo-hlr_10.42.42.2(pid=14281): Launched 02:34:42.602262 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:43.156788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Launched 02:34:43.475828 run osmo-stp_10.42.42.5(pid=14284): Launched 02:34:43.598962 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:44.151333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Launched 02:34:44.274588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:44.545113 run patchelf(pid=14287): Launched 02:34:44.723931 run osmo-stp_10.42.42.5(pid=14284): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] 02:34:44.859903 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-10_02:34:43.417965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:44.997271 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221210023443609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023443609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023443610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023443610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:45.134177 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-10_02:34:43.417965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:45.265202 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221210023443609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023443609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023443610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023443610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023443611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:45.420668 run patchelf(pid=14287): Terminating (SIGINT) 02:34:45.600316 run patchelf(pid=14287): Terminated: ok {rc=0} 02:34:45.730006 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:34:45.739406 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:34:45.767573 run osmo-hlr_10.42.42.2(pid=14281): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14281)] 02:34:45.818142 run osmo-hlr_10.42.42.2(pid=14281): stdout: | (launched: 2022-12-10_02:34:42.421266) 02:34:45.884382 run osmo-hlr_10.42.42.2(pid=14281): stderr: | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023442620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023442632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023442642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023442642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023442642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:45.946452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminating (SIGTERM) 02:34:45.990904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminating (SIGTERM) 02:34:46.034815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Terminating (SIGTERM) 02:34:46.083571 --- ParallelTerminationStrategy: PID 14280 died... 02:34:46.104195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminated: ok {rc=0} 02:34:46.151933 --- ParallelTerminationStrategy: PID 14283 died... 02:34:46.172302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminated: ok {rc=0} 02:34:46.219791 --- ParallelTerminationStrategy: PID 14286 died... 02:34:46.240099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Terminated: ok {rc=0} 02:34:46.330646 bus /gobi_0: Setting Powered False 02:34:47.429606 bus /gobi_0: Setting Powered False 02:34:48.547529 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:34:49.802171 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:34:49.807800 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:34:49.842902 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:34:49.877994 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:34:49.930736 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:34:49.965135 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:34:50.000576 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:34:50.558152 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:34:50.563631 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:50.575046 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:34:50.644822 tst switch_tch_pdch.py: using LAC 25386 02:34:50.768545 tst switch_tch_pdch.py: using RAC 141 02:34:50.893674 tst switch_tch_pdch.py: using CellId 25386 02:34:51.016849 tst switch_tch_pdch.py: using BVCI 25387 02:34:51.132933 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.144334 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.155559 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.166790 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.177991 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.189195 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.200448 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:34:51.211583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:34:51.327240 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:34:51.446388 tst switch_tch_pdch.py:51: start network... 02:34:51.662825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:52.129766 run create_hlr_db(pid=14291): Launched 02:34:52.259428 bus /gobi_6: Setting Powered False 02:34:53.322433 run create_hlr_db(pid=14291): Terminated: ok {rc=0} 02:34:53.724767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14293): Launched 02:34:54.023399 run osmo-hlr_10.42.42.2(pid=14294): Launched 02:34:54.138058 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:54.626371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14296): Launched 02:34:54.925723 run osmo-stp_10.42.42.5(pid=14297): Launched 02:34:55.039661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:55.534642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14299): Launched 02:34:55.649563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:55.901649 run patchelf(pid=14300): Launched 02:34:56.071322 run osmo-stp_10.42.42.5(pid=14297): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14297)] 02:34:56.198997 run osmo-stp_10.42.42.5(pid=14297): stdout: | (launched: 2022-12-10_02:34:54.871249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:56.327705 run osmo-stp_10.42.42.5(pid=14297): stderr: | [0;m[38;5;43m20221210023455041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023455042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023455042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023455042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:56.456473 run osmo-stp_10.42.42.5(pid=14297): stdout: | (launched: 2022-12-10_02:34:54.871249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:56.579865 run osmo-stp_10.42.42.5(pid=14297): stderr: | [0;m[38;5;43m20221210023455041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023455042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023455042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023455042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023455043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:56.725512 run patchelf(pid=14300): Terminating (SIGINT) 02:34:56.894198 run patchelf(pid=14300): Terminated: ok {rc=0} 02:34:57.015630 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14297): Process ended prematurely: osmo-stp_10.42.42.5(pid=14297) [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14297)] [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:34:57.024656 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:34:57.051618 run osmo-hlr_10.42.42.2(pid=14294): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14294)] 02:34:57.099623 run osmo-hlr_10.42.42.2(pid=14294): stdout: | (launched: 2022-12-10_02:34:53.968894) 02:34:57.149313 run osmo-hlr_10.42.42.2(pid=14294): stderr: | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023454145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023454157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023454167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023454168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023454168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:57.199445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14293): Terminating (SIGTERM) 02:34:57.239617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14296): Terminating (SIGTERM) 02:34:57.279685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14299): Terminating (SIGTERM) 02:34:57.320132 --- ParallelTerminationStrategy: PID 14293 died... 02:34:57.339229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14293): Terminated: ok {rc=0} 02:34:57.383391 --- ParallelTerminationStrategy: PID 14296 died... 02:34:57.402027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14296): Terminated: ok {rc=0} 02:34:57.446038 --- ParallelTerminationStrategy: PID 14299 died... 02:34:57.464747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14299): Terminated: ok {rc=0} 02:34:57.552761 bus /gobi_0: Setting Powered False 02:34:58.654073 bus /gobi_0: Setting Powered False 02:34:59.769378 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:01.059811 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:01.066338 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:01.105271 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:35:01.112740 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:01.166714 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:01.222779 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:35:01.235611 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:01.745847 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:01.752510 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:35:01.765229 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:01.817601 tst mo_mt_sms.py: using LAC 25387 02:35:01.951544 tst mo_mt_sms.py: using RAC 142 02:35:02.078548 tst mo_mt_sms.py: using CellId 25387 02:35:02.202608 tst mo_mt_sms.py: using BVCI 25388 02:35:02.324900 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:02.448259 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:02.568860 tst mo_mt_sms.py:9: start nitb and bts... 02:35:02.786208 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:35:03.434933 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14307): Launched 02:35:03.753753 run osmo-nitb_10.42.42.2(pid=14308): Launched 02:35:03.931081 run osmo-nitb_10.42.42.2(pid=14308): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14308)] 02:35:04.074685 run osmo-nitb_10.42.42.2(pid=14308): stdout: | (launched: 2022-12-10_02:35:03.695784) 02:35:04.219235 run osmo-nitb_10.42.42.2(pid=14308): stderr: | (launched: 2022-12-10_02:35:03.743228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:04.363816 run osmo-nitb_10.42.42.2(pid=14308): stdout: | (launched: 2022-12-10_02:35:03.695784) 02:35:04.502837 run osmo-nitb_10.42.42.2(pid=14308): stderr: | (launched: 2022-12-10_02:35:03.743228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14308): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14308) [trial-2368↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14308)] 02:35:04.874393 tst osmo-nitb_10.42.42.2(pid=14308): stdout: | (launched: 2022-12-10_02:35:03.695784) 02:35:05.003327 tst osmo-nitb_10.42.42.2(pid=14308): stderr: | (launched: 2022-12-10_02:35:03.743228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:05.154840 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14308): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14308) [trial-2368↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14308)] [trial-2368↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 02:35:05.163845 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 02:35:05.171073 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14307): Terminating (SIGTERM) 02:35:05.382042 --- ParallelTerminationStrategy: PID 14307 died... 02:35:05.404117 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14307): Terminated: ok {rc=0} 02:35:05.492285 bus /sierra_3: Setting Powered False 02:35:06.592987 bus /sierra_3: Setting Powered False 02:35:07.710612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:08.911357 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:08.915572 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:08.950094 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:35:08.977448 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:09.031728 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:09.066378 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:35:09.093593 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:09.641157 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:09.647190 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:09.658876 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:09.708165 tst mo_mt_sms.py: using LAC 25388 02:35:09.834229 tst mo_mt_sms.py: using RAC 143 02:35:09.959924 tst mo_mt_sms.py: using CellId 25388 02:35:10.079743 tst mo_mt_sms.py: using BVCI 25389 02:35:10.190162 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:10.200788 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:10.211641 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:10.222647 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:10.233391 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:10.244242 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:10.360323 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:10.475541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:10.937615 run create_hlr_db(pid=14314): Launched 02:35:11.051717 bus /sierra_2: Setting Powered False 02:35:12.112282 run create_hlr_db(pid=14314): Terminated: ok {rc=0} 02:35:12.529374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14316): Launched 02:35:12.829215 run osmo-hlr_10.42.42.2(pid=14317): Launched 02:35:12.942851 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:13.453915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14319): Launched 02:35:13.752822 run osmo-stp_10.42.42.5(pid=14320): Launched 02:35:13.867344 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:14.405790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14322): Launched 02:35:14.705396 run osmo-msc_10.42.42.6(pid=14323): Launched 02:35:14.872453 run osmo-stp_10.42.42.5(pid=14320): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14320)] 02:35:14.999390 run osmo-stp_10.42.42.5(pid=14320): stdout: | (launched: 2022-12-10_02:35:13.697994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:15.127389 run osmo-stp_10.42.42.5(pid=14320): stderr: | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023513868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:15.252476 run osmo-stp_10.42.42.5(pid=14320): stdout: | (launched: 2022-12-10_02:35:13.697994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:15.371307 run osmo-stp_10.42.42.5(pid=14320): stderr: | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023513868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023513868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023513869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:15.514011 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14320): Process ended prematurely: osmo-stp_10.42.42.5(pid=14320) [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14320)] [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 02:35:15.522205 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:35:15.548667 run osmo-hlr_10.42.42.2(pid=14317): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14317)] 02:35:15.596690 run osmo-hlr_10.42.42.2(pid=14317): stdout: | (launched: 2022-12-10_02:35:12.774351) 02:35:15.646387 run osmo-hlr_10.42.42.2(pid=14317): stderr: | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023512951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023512963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023512973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023512974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:15.715606 run osmo-msc_10.42.42.6(pid=14323): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14323)] 02:35:15.764101 run osmo-msc_10.42.42.6(pid=14323): stdout: | (launched: 2022-12-10_02:35:14.649458) 02:35:15.813863 run osmo-msc_10.42.42.6(pid=14323): stderr: | [0;m[38;5;43m20221210023514923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023514923 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f640349cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023514923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023514923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023514924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023514924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023514925 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023514926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023514926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023514926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:15.884935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14316): Terminating (SIGTERM) 02:35:15.935882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14319): Terminating (SIGTERM) 02:35:15.981373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14322): Terminating (SIGTERM) 02:35:16.027633 --- ParallelTerminationStrategy: PID 14316 died... 02:35:16.048624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14316): Terminated: ok {rc=0} 02:35:16.099067 --- ParallelTerminationStrategy: PID 14319 died... 02:35:16.120813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14319): Terminated: ok {rc=0} 02:35:16.169213 --- ParallelTerminationStrategy: PID 14322 died... 02:35:16.189935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14322): Terminated: ok {rc=0} 02:35:16.287163 bus /sierra_3: Setting Powered False 02:35:17.397372 bus /sierra_3: Setting Powered False 02:35:18.512874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:19.744541 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:19.748176 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:19.782079 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:35:19.788792 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:35:19.824251 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:19.860113 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:35:19.867123 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:35:20.385552 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:35:20.390664 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:35:20.402017 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:20.453264 tst assert_extension.py: using LAC 25389 02:35:20.580676 tst assert_extension.py: using RAC 144 02:35:20.707545 tst assert_extension.py: using CellId 25389 02:35:20.833410 tst assert_extension.py: using BVCI 25390 02:35:20.950097 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:35:21.063514 tst assert_extension.py:10: start nitb and bts... 02:35:21.263714 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:35:21.872802 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14328): Launched 02:35:22.170600 run osmo-nitb_10.42.42.2(pid=14329): Launched 02:35:22.336113 run osmo-nitb_10.42.42.2(pid=14329): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14329)] 02:35:22.470107 run osmo-nitb_10.42.42.2(pid=14329): stdout: | (launched: 2022-12-10_02:35:22.116132) 02:35:22.606356 run osmo-nitb_10.42.42.2(pid=14329): stderr: | (launched: 2022-12-10_02:35:22.160169) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:22.741837 run osmo-nitb_10.42.42.2(pid=14329): stdout: | (launched: 2022-12-10_02:35:22.116132) 02:35:22.872941 run osmo-nitb_10.42.42.2(pid=14329): stderr: | (launched: 2022-12-10_02:35:22.160169) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14329) [trial-2368↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14329)] 02:35:23.283035 tst osmo-nitb_10.42.42.2(pid=14329): stdout: | (launched: 2022-12-10_02:35:22.116132) 02:35:23.404928 tst osmo-nitb_10.42.42.2(pid=14329): stderr: | (launched: 2022-12-10_02:35:22.160169) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:23.547704 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14329) [trial-2368↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14329)] [trial-2368↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 02:35:23.556028 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:35:23.562638 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14328): Terminating (SIGTERM) 02:35:23.774087 --- ParallelTerminationStrategy: PID 14328 died... 02:35:23.795153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14328): Terminated: ok {rc=0} 02:35:23.883372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:25.067001 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:25.071175 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:25.106017 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:35:25.133507 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:35:25.169329 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:25.203342 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:35:25.229973 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:35:25.764418 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:35:25.770561 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:25.783394 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:25.834944 tst assert_extension.py: using LAC 25390 02:35:25.955117 tst assert_extension.py: using RAC 145 02:35:26.074155 tst assert_extension.py: using CellId 25390 02:35:26.193998 tst assert_extension.py: using BVCI 25391 02:35:26.302363 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:26.313656 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:26.324309 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:26.335329 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:26.346306 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:26.357106 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:35:26.474838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:26.970962 run create_hlr_db(pid=14333): Launched 02:35:27.101945 bus /sierra_2: Setting Powered False 02:35:28.165284 run create_hlr_db(pid=14333): Terminated: ok {rc=0} 02:35:28.592936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Launched 02:35:28.890215 run osmo-hlr_10.42.42.2(pid=14336): Launched 02:35:29.004565 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:29.617022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Launched 02:35:29.911446 run osmo-stp_10.42.42.5(pid=14339): Launched 02:35:30.024417 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:30.554666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Launched 02:35:30.869783 run osmo-msc_10.42.42.6(pid=14342): Launched 02:35:31.456890 run osmo-stp_10.42.42.5(pid=14339): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] 02:35:31.890689 run osmo-stp_10.42.42.5(pid=14339): stdout: | (launched: 2022-12-10_02:35:29.857580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:32.017233 run osmo-stp_10.42.42.5(pid=14339): stderr: | [0;m[38;5;43m20221210023530025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023530025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023530026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023530026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023530026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023530027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023530027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:32.143054 run osmo-stp_10.42.42.5(pid=14339): stdout: | (launched: 2022-12-10_02:35:29.857580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:32.262712 run osmo-stp_10.42.42.5(pid=14339): stderr: | [0;m[38;5;43m20221210023530025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023530025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023530026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023530026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023530026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023530027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023530027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:32.404327 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14339): Process ended prematurely: osmo-stp_10.42.42.5(pid=14339) [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py:17] 02:35:32.412463 tst assert_extension.py:17: Test FAILED (6.6 sec) 02:35:32.438703 run osmo-hlr_10.42.42.2(pid=14336): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14336)] 02:35:32.486493 run osmo-hlr_10.42.42.2(pid=14336): stdout: | (launched: 2022-12-10_02:35:28.835808) 02:35:32.535855 run osmo-hlr_10.42.42.2(pid=14336): stderr: | [0;m[1;31m20221210023529012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023529013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023529013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023529013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023529013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023529013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023529024 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023529035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023529035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023529035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:32.604760 run osmo-msc_10.42.42.6(pid=14342): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14342)] 02:35:32.652725 run osmo-msc_10.42.42.6(pid=14342): stdout: | (launched: 2022-12-10_02:35:30.794867) 02:35:32.702847 run osmo-msc_10.42.42.6(pid=14342): stderr: | [0;m[38;5;43m20221210023531431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023531431 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbc22b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023531431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023531431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023531432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023531433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023531437 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023531438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023531438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023531439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:32.753065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Terminating (SIGTERM) 02:35:32.792806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Terminating (SIGTERM) 02:35:32.833201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Terminating (SIGTERM) 02:35:32.874099 --- ParallelTerminationStrategy: PID 14335 died... 02:35:32.893204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14335): Terminated: ok {rc=0} 02:35:32.937655 --- ParallelTerminationStrategy: PID 14338 died... 02:35:32.956161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14338): Terminated: ok {rc=0} 02:35:33.000208 --- ParallelTerminationStrategy: PID 14341 died... 02:35:33.018618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14341): Terminated: ok {rc=0} 02:35:33.105652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:35:34.322502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:34.329417 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:35:34.366240 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:35:34.393240 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:35:34.445178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:35:34.479149 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:35:34.505482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:35:35.055296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:35:35.104319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.115590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:35:35.185152 tst mo_mt_call.py: using LAC 25391 02:35:35.305089 tst mo_mt_call.py: using RAC 146 02:35:35.425071 tst mo_mt_call.py: using CellId 25391 02:35:35.545269 tst mo_mt_call.py: using BVCI 25392 02:35:35.655546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.666729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.677659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.688862 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.700192 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:35.711387 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:35.825711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:35.943638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:36.409413 run create_hlr_db(pid=14347): Launched 02:35:36.524684 bus /sierra_2: Setting Powered False 02:35:37.584840 run create_hlr_db(pid=14347): Terminated: ok {rc=0} 02:35:38.023710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14349): Launched 02:35:38.344514 run osmo-hlr_10.42.42.2(pid=14350): Launched 02:35:38.467714 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:39.022010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14352): Launched 02:35:39.342882 run osmo-stp_10.42.42.5(pid=14353): Launched 02:35:39.466117 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:40.044130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14355): Launched 02:35:40.346996 run osmo-msc_10.42.42.6(pid=14356): Launched 02:35:40.514788 run osmo-stp_10.42.42.5(pid=14353): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14353)] 02:35:40.641833 run osmo-stp_10.42.42.5(pid=14353): stdout: | (launched: 2022-12-10_02:35:39.284643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:40.769746 run osmo-stp_10.42.42.5(pid=14353): stderr: | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023539477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:40.895626 run osmo-stp_10.42.42.5(pid=14353): stdout: | (launched: 2022-12-10_02:35:39.284643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:41.015381 run osmo-stp_10.42.42.5(pid=14353): stderr: | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023539476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023539477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023539477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:41.158279 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14353): Process ended prematurely: osmo-stp_10.42.42.5(pid=14353) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14353)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:35:41.166988 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:35:41.193361 run osmo-hlr_10.42.42.2(pid=14350): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14350)] 02:35:41.241382 run osmo-hlr_10.42.42.2(pid=14350): stdout: | (launched: 2022-12-10_02:35:38.286440) 02:35:41.290480 run osmo-hlr_10.42.42.2(pid=14350): stderr: | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023538484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023538496 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023538505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023538505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023538506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:41.359143 run osmo-msc_10.42.42.6(pid=14356): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14356)] 02:35:41.407016 run osmo-msc_10.42.42.6(pid=14356): stdout: | (launched: 2022-12-10_02:35:40.291942) 02:35:41.456478 run osmo-msc_10.42.42.6(pid=14356): stderr: | [0;m[38;5;43m20221210023540564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023540564 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54e0994c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023540564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023540564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023540564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023540564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023540566 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023540567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023540567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023540567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:41.506475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14349): Terminating (SIGTERM) 02:35:41.546247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14352): Terminating (SIGTERM) 02:35:41.585978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14355): Terminating (SIGTERM) 02:35:41.626085 --- ParallelTerminationStrategy: PID 14349 died... 02:35:41.645181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14349): Terminated: ok {rc=0} 02:35:41.689547 --- ParallelTerminationStrategy: PID 14352 died... 02:35:41.707958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14352): Terminated: ok {rc=0} 02:35:41.752094 --- ParallelTerminationStrategy: PID 14355 died... 02:35:41.770657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14355): Terminated: ok {rc=0} 02:35:41.856643 bus /sierra_3: Setting Powered False 02:35:42.956733 bus /sierra_3: Setting Powered False 02:35:44.071958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:35:45.217961 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.229849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:35:45.300816 tst mo_mt_call_osmux.py: using LAC 25392 02:35:45.420785 tst mo_mt_call_osmux.py: using RAC 147 02:35:45.539133 tst mo_mt_call_osmux.py: using CellId 25392 02:35:45.659167 tst mo_mt_call_osmux.py: using BVCI 25393 02:35:45.770014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.781221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.792227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.803550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.814831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:45.826040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:45.965616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:46.121758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:46.697265 run create_hlr_db(pid=14358): Launched 02:35:46.857166 bus /sierra_2: Setting Powered False 02:35:47.917807 run create_hlr_db(pid=14358): Terminated: ok {rc=0} 02:35:48.373547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Launched 02:35:48.696942 run osmo-hlr_10.42.42.2(pid=14361): Launched 02:35:48.819991 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:49.375032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Launched 02:35:49.697870 run osmo-stp_10.42.42.5(pid=14364): Launched 02:35:49.821434 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:50.404216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Launched 02:35:50.726334 run osmo-msc_10.42.42.6(pid=14367): Launched 02:35:50.905946 run osmo-stp_10.42.42.5(pid=14364): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] 02:35:51.041362 run osmo-stp_10.42.42.5(pid=14364): stdout: | (launched: 2022-12-10_02:35:49.639432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:51.178065 run osmo-stp_10.42.42.5(pid=14364): stderr: | [0;m[38;5;43m20221210023549830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023549831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:51.313602 run osmo-stp_10.42.42.5(pid=14364): stdout: | (launched: 2022-12-10_02:35:49.639432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:51.441419 run osmo-stp_10.42.42.5(pid=14364): stderr: | [0;m[38;5;43m20221210023549830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023549831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023549831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023549832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:51.594618 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14364): Process ended prematurely: osmo-stp_10.42.42.5(pid=14364) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:35:51.604020 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:35:51.631475 run osmo-hlr_10.42.42.2(pid=14361): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14361)] 02:35:51.681391 run osmo-hlr_10.42.42.2(pid=14361): stdout: | (launched: 2022-12-10_02:35:48.638225) 02:35:51.733122 run osmo-hlr_10.42.42.2(pid=14361): stderr: | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023548836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023548848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023548857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023548857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023548857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:51.804716 run osmo-msc_10.42.42.6(pid=14367): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14367)] 02:35:51.854330 run osmo-msc_10.42.42.6(pid=14367): stdout: | (launched: 2022-12-10_02:35:50.667750) 02:35:51.906005 run osmo-msc_10.42.42.6(pid=14367): stderr: | [0;m[38;5;43m20221210023550990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023550991 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3944d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023550991 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023550991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023550991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023550991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023550993 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023550993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023550993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023550993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:51.957875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Terminating (SIGTERM) 02:35:51.999351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Terminating (SIGTERM) 02:35:52.040594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Terminating (SIGTERM) 02:35:52.082224 --- ParallelTerminationStrategy: PID 14360 died... 02:35:52.102052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14360): Terminated: ok {rc=0} 02:35:52.147911 --- ParallelTerminationStrategy: PID 14363 died... 02:35:52.167243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14363): Terminated: ok {rc=0} 02:35:52.213058 --- ParallelTerminationStrategy: PID 14366 died... 02:35:52.232468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14366): Terminated: ok {rc=0} 02:35:52.320937 bus /sierra_3: Setting Powered False 02:35:53.421136 bus /sierra_3: Setting Powered False 02:35:54.537378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:35:55.785725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:55.793771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:35:55.828069 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:35:55.855325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:35:55.911031 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:35:55.945400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:35:55.972654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:35:56.523521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:35:56.574795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:56.586501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:35:56.656591 tst mo_mt_call.py: using LAC 25393 02:35:56.781366 tst mo_mt_call.py: using RAC 148 02:35:56.905943 tst mo_mt_call.py: using CellId 25393 02:35:57.030647 tst mo_mt_call.py: using BVCI 25394 02:35:57.149387 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:57.161041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:57.172551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:57.184100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:57.195637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:35:57.207032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:35:57.322550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:35:57.442284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:57.942512 run create_hlr_db(pid=14372): Launched 02:35:58.073989 bus /sierra_2: Setting Powered False 02:35:59.137448 run create_hlr_db(pid=14372): Terminated: ok {rc=0} 02:35:59.567147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Launched 02:35:59.868668 run osmo-hlr_10.42.42.2(pid=14375): Launched 02:35:59.984201 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:00.519621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Launched 02:36:00.821456 run osmo-stp_10.42.42.5(pid=14378): Launched 02:36:01.042361 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:01.737184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Launched 02:36:02.063357 run osmo-msc_10.42.42.6(pid=14381): Launched 02:36:02.286697 run osmo-stp_10.42.42.5(pid=14378): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] 02:36:02.487260 run osmo-stp_10.42.42.5(pid=14378): stdout: | (launched: 2022-12-10_02:36:00.766310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:02.626933 run osmo-stp_10.42.42.5(pid=14378): stderr: | [0;m[38;5;43m20221210023601036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023601040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023601041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023601041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:02.766244 run osmo-stp_10.42.42.5(pid=14378): stdout: | (launched: 2022-12-10_02:36:00.766310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:02.894816 run osmo-stp_10.42.42.5(pid=14378): stderr: | [0;m[38;5;43m20221210023601036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023601040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023601041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023601041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023601042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:03.048644 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14378): Process ended prematurely: osmo-stp_10.42.42.5(pid=14378) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:36:03.058340 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:36:03.086403 run osmo-hlr_10.42.42.2(pid=14375): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14375)] 02:36:03.136623 run osmo-hlr_10.42.42.2(pid=14375): stdout: | (launched: 2022-12-10_02:35:59.813403) 02:36:03.188304 run osmo-hlr_10.42.42.2(pid=14375): stderr: | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023559990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023600002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023600013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023600013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023600014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:03.260153 run osmo-msc_10.42.42.6(pid=14381): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14381)] 02:36:03.310180 run osmo-msc_10.42.42.6(pid=14381): stdout: | (launched: 2022-12-10_02:36:01.993986) 02:36:03.361807 run osmo-msc_10.42.42.6(pid=14381): stderr: | [0;m[38;5;43m20221210023602503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023602504 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f587a950c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023602504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023602504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023602504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023602504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023602506 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023602506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023602506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023602506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:03.413950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Terminating (SIGTERM) 02:36:03.455506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Terminating (SIGTERM) 02:36:03.497074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Terminating (SIGTERM) 02:36:03.539121 --- ParallelTerminationStrategy: PID 14374 died... 02:36:03.559088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14374): Terminated: ok {rc=0} 02:36:03.605212 --- ParallelTerminationStrategy: PID 14377 died... 02:36:03.624772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14377): Terminated: ok {rc=0} 02:36:03.670762 --- ParallelTerminationStrategy: PID 14380 died... 02:36:03.690408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14380): Terminated: ok {rc=0} 02:36:03.777703 bus /sierra_3: Setting Powered False 02:36:04.876257 bus /sierra_3: Setting Powered False 02:36:05.994546 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:36:07.143974 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.156455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:36:07.228822 tst mo_mt_call_osmux.py: using LAC 25394 02:36:07.355686 tst mo_mt_call_osmux.py: using RAC 149 02:36:07.482342 tst mo_mt_call_osmux.py: using CellId 25394 02:36:07.607952 tst mo_mt_call_osmux.py: using BVCI 25395 02:36:07.725005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.736848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.748484 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.759963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.771731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:07.783465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:07.901737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:08.019135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:08.485536 run create_hlr_db(pid=14383): Launched 02:36:08.602448 bus /sierra_2: Setting Powered False 02:36:09.662643 run create_hlr_db(pid=14383): Terminated: ok {rc=0} 02:36:10.102334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Launched 02:36:10.424719 run osmo-hlr_10.42.42.2(pid=14386): Launched 02:36:10.548171 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:11.104152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Launched 02:36:11.426487 run osmo-stp_10.42.42.5(pid=14389): Launched 02:36:11.550312 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:12.133277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Launched 02:36:12.456761 run osmo-msc_10.42.42.6(pid=14392): Launched 02:36:12.638097 run osmo-stp_10.42.42.5(pid=14389): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] 02:36:12.778552 run osmo-stp_10.42.42.5(pid=14389): stdout: | (launched: 2022-12-10_02:36:11.367866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:12.915860 run osmo-stp_10.42.42.5(pid=14389): stderr: | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023611560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:13.050945 run osmo-stp_10.42.42.5(pid=14389): stdout: | (launched: 2022-12-10_02:36:11.367866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:13.179603 run osmo-stp_10.42.42.5(pid=14389): stderr: | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023611559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023611560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023611560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:13.333418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14389): Process ended prematurely: osmo-stp_10.42.42.5(pid=14389) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:36:13.343001 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:36:13.370531 run osmo-hlr_10.42.42.2(pid=14386): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14386)] 02:36:13.420287 run osmo-hlr_10.42.42.2(pid=14386): stdout: | (launched: 2022-12-10_02:36:10.366375) 02:36:13.471583 run osmo-hlr_10.42.42.2(pid=14386): stderr: | [0;m[1;31m20221210023610564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023610565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023610565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023610565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023610565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023610565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023610577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023610585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023610585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023610585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:13.543298 run osmo-msc_10.42.42.6(pid=14392): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14392)] 02:36:13.593371 run osmo-msc_10.42.42.6(pid=14392): stdout: | (launched: 2022-12-10_02:36:12.398116) 02:36:13.644490 run osmo-msc_10.42.42.6(pid=14392): stderr: | [0;m[38;5;43m20221210023612721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023612721 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2594db6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023612721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023612721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023612721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023612722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023612723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023612724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023612724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023612724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:13.696258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Terminating (SIGTERM) 02:36:13.737380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Terminating (SIGTERM) 02:36:13.778738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Terminating (SIGTERM) 02:36:13.820526 --- ParallelTerminationStrategy: PID 14385 died... 02:36:13.840434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14385): Terminated: ok {rc=0} 02:36:13.886561 --- ParallelTerminationStrategy: PID 14388 died... 02:36:13.906040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14388): Terminated: ok {rc=0} 02:36:13.951797 --- ParallelTerminationStrategy: PID 14391 died... 02:36:13.971330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14391): Terminated: ok {rc=0} 02:36:14.057747 bus /sierra_3: Setting Powered False 02:36:15.154386 bus /sierra_3: Setting Powered False 02:36:16.271001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:36:17.540530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:17.547551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:36:17.581970 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:36:17.609491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:36:17.660777 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:36:17.695352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:36:17.722497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:36:18.277096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:36:18.328217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.339959 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:36:18.410460 tst mo_mt_call.py: using LAC 25395 02:36:18.537024 tst mo_mt_call.py: using RAC 150 02:36:18.661879 tst mo_mt_call.py: using CellId 25395 02:36:18.786844 tst mo_mt_call.py: using BVCI 25396 02:36:18.904726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.916510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.928157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.939678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.951334 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:18.962914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:19.078141 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:19.194557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:19.662796 run create_hlr_db(pid=14398): Launched 02:36:19.779681 bus /sierra_2: Setting Powered False 02:36:20.839915 run create_hlr_db(pid=14398): Terminated: ok {rc=0} 02:36:21.260743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14400): Launched 02:36:21.563564 run osmo-hlr_10.42.42.2(pid=14401): Launched 02:36:21.679214 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:22.196486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14403): Launched 02:36:22.498911 run osmo-stp_10.42.42.5(pid=14404): Launched 02:36:22.614874 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:23.160279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14406): Launched 02:36:23.463658 run osmo-msc_10.42.42.6(pid=14407): Launched 02:36:23.633290 run osmo-stp_10.42.42.5(pid=14404): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14404)] 02:36:23.761885 run osmo-stp_10.42.42.5(pid=14404): stdout: | (launched: 2022-12-10_02:36:22.443750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:23.890281 run osmo-stp_10.42.42.5(pid=14404): stderr: | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023622615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:24.017311 run osmo-stp_10.42.42.5(pid=14404): stdout: | (launched: 2022-12-10_02:36:22.443750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:24.137341 run osmo-stp_10.42.42.5(pid=14404): stderr: | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023622614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023622615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023622615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:24.280571 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14404): Process ended prematurely: osmo-stp_10.42.42.5(pid=14404) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14404)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:36:24.289428 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:36:24.315781 run osmo-hlr_10.42.42.2(pid=14401): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14401)] 02:36:24.363490 run osmo-hlr_10.42.42.2(pid=14401): stdout: | (launched: 2022-12-10_02:36:21.508430) 02:36:24.412821 run osmo-hlr_10.42.42.2(pid=14401): stderr: | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023621683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023621695 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023621705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023621706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023621706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:24.481813 run osmo-msc_10.42.42.6(pid=14407): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14407)] 02:36:24.529465 run osmo-msc_10.42.42.6(pid=14407): stdout: | (launched: 2022-12-10_02:36:23.408487) 02:36:24.578656 run osmo-msc_10.42.42.6(pid=14407): stderr: | [0;m[38;5;43m20221210023623681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023623681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe04024c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023623681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023623681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023623681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023623681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023623683 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023623683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023623684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023623684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:24.628125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14400): Terminating (SIGTERM) 02:36:24.667496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14403): Terminating (SIGTERM) 02:36:24.707110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14406): Terminating (SIGTERM) 02:36:24.747010 --- ParallelTerminationStrategy: PID 14400 died... 02:36:24.765951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14400): Terminated: ok {rc=0} 02:36:24.810186 --- ParallelTerminationStrategy: PID 14403 died... 02:36:24.828475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14403): Terminated: ok {rc=0} 02:36:24.872473 --- ParallelTerminationStrategy: PID 14406 died... 02:36:24.891153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14406): Terminated: ok {rc=0} 02:36:24.974596 bus /sierra_3: Setting Powered False 02:36:26.073045 bus /sierra_3: Setting Powered False 02:36:27.192063 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:36:28.338029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.349888 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:36:28.420562 tst mo_mt_call_osmux.py: using LAC 25396 02:36:28.538867 tst mo_mt_call_osmux.py: using RAC 151 02:36:28.660577 tst mo_mt_call_osmux.py: using CellId 25396 02:36:28.782057 tst mo_mt_call_osmux.py: using BVCI 25397 02:36:28.894033 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.905314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.916367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.927719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.939123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:28.950402 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:29.069057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:29.186633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:29.657776 run create_hlr_db(pid=14409): Launched 02:36:29.774591 bus /sierra_2: Setting Powered False 02:36:30.835820 run create_hlr_db(pid=14409): Terminated: ok {rc=0} 02:36:31.287304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Launched 02:36:31.609080 run osmo-hlr_10.42.42.2(pid=14412): Launched 02:36:31.845453 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:32.527559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Launched 02:36:32.829560 run osmo-stp_10.42.42.5(pid=14415): Launched 02:36:32.946298 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:33.495930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Launched 02:36:33.799226 run osmo-msc_10.42.42.6(pid=14418): Launched 02:36:33.969114 run osmo-stp_10.42.42.5(pid=14415): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] 02:36:34.097801 run osmo-stp_10.42.42.5(pid=14415): stdout: | (launched: 2022-12-10_02:36:32.774152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:34.227073 run osmo-stp_10.42.42.5(pid=14415): stderr: | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023632944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:34.353657 run osmo-stp_10.42.42.5(pid=14415): stdout: | (launched: 2022-12-10_02:36:32.774152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:34.473677 run osmo-stp_10.42.42.5(pid=14415): stderr: | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023632943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023632944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023632944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:34.617357 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14415): Process ended prematurely: osmo-stp_10.42.42.5(pid=14415) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:36:34.626172 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:36:34.652713 run osmo-hlr_10.42.42.2(pid=14412): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14412)] 02:36:34.700255 run osmo-hlr_10.42.42.2(pid=14412): stdout: | (launched: 2022-12-10_02:36:31.548919) 02:36:34.749686 run osmo-hlr_10.42.42.2(pid=14412): stderr: | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023631888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023631917 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023631934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023631934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023631934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:34.818413 run osmo-msc_10.42.42.6(pid=14418): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14418)] 02:36:34.866141 run osmo-msc_10.42.42.6(pid=14418): stdout: | (launched: 2022-12-10_02:36:33.743705) 02:36:34.915485 run osmo-msc_10.42.42.6(pid=14418): stderr: | [0;m[38;5;43m20221210023634015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023634015 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f53518d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023634015 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023634015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023634015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023634015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023634017 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023634018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023634018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023634018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:34.965363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Terminating (SIGTERM) 02:36:35.005178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Terminating (SIGTERM) 02:36:35.044840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Terminating (SIGTERM) 02:36:35.084852 --- ParallelTerminationStrategy: PID 14411 died... 02:36:35.103835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Terminated: ok {rc=0} 02:36:35.148103 --- ParallelTerminationStrategy: PID 14414 died... 02:36:35.166629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Terminated: ok {rc=0} 02:36:35.210453 --- ParallelTerminationStrategy: PID 14417 died... 02:36:35.228898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Terminated: ok {rc=0} 02:36:35.314256 bus /sierra_3: Setting Powered False 02:36:36.413207 bus /sierra_3: Setting Powered False 02:36:37.528234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:36:38.782440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:38.789956 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:36:38.823884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:36:38.850516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:36:38.899845 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:36:38.933463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:36:38.960056 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:36:39.518205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:36:39.567212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:39.578566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:36:39.646750 tst mo_mt_call.py: using LAC 25397 02:36:39.772622 tst mo_mt_call.py: using RAC 152 02:36:39.891893 tst mo_mt_call.py: using CellId 25397 02:36:40.016874 tst mo_mt_call.py: using BVCI 25398 02:36:40.133902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:40.145627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:40.157204 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:40.168738 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:40.180464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:40.191884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:40.307537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:40.422211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:40.923886 run create_hlr_db(pid=14423): Launched 02:36:41.043818 bus /sierra_2: Setting Powered False 02:36:42.103166 run create_hlr_db(pid=14423): Terminated: ok {rc=0} 02:36:42.523327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Launched 02:36:42.825218 run osmo-hlr_10.42.42.2(pid=14426): Launched 02:36:42.941125 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:43.460306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Launched 02:36:43.763581 run osmo-stp_10.42.42.5(pid=14429): Launched 02:36:43.879911 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:44.426254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Launched 02:36:44.727332 run osmo-msc_10.42.42.6(pid=14432): Launched 02:36:44.897581 run osmo-stp_10.42.42.5(pid=14429): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] 02:36:45.025678 run osmo-stp_10.42.42.5(pid=14429): stdout: | (launched: 2022-12-10_02:36:43.707811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:45.154094 run osmo-stp_10.42.42.5(pid=14429): stderr: | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023643879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:45.280444 run osmo-stp_10.42.42.5(pid=14429): stdout: | (launched: 2022-12-10_02:36:43.707811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:45.399777 run osmo-stp_10.42.42.5(pid=14429): stderr: | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023643878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023643879 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023643879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:45.543224 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14429): Process ended prematurely: osmo-stp_10.42.42.5(pid=14429) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:36:45.551937 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:36:45.578411 run osmo-hlr_10.42.42.2(pid=14426): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14426)] 02:36:45.625634 run osmo-hlr_10.42.42.2(pid=14426): stdout: | (launched: 2022-12-10_02:36:42.770253) 02:36:45.674977 run osmo-hlr_10.42.42.2(pid=14426): stderr: | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023642946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023642962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023642971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023642971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023642971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:45.743948 run osmo-msc_10.42.42.6(pid=14432): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14432)] 02:36:45.791308 run osmo-msc_10.42.42.6(pid=14432): stdout: | (launched: 2022-12-10_02:36:44.672276) 02:36:45.841509 run osmo-msc_10.42.42.6(pid=14432): stderr: | [0;m[38;5;43m20221210023644942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023644942 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb365785c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023644942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023644943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023644943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023644943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023644945 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023644945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023644945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023644945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:45.893057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Terminating (SIGTERM) 02:36:45.934102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Terminating (SIGTERM) 02:36:45.975411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Terminating (SIGTERM) 02:36:46.016747 --- ParallelTerminationStrategy: PID 14425 died... 02:36:46.036284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14425): Terminated: ok {rc=0} 02:36:46.083380 --- ParallelTerminationStrategy: PID 14428 died... 02:36:46.102636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14428): Terminated: ok {rc=0} 02:36:46.149451 --- ParallelTerminationStrategy: PID 14431 died... 02:36:46.168868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14431): Terminated: ok {rc=0} 02:36:46.256593 bus /sierra_3: Setting Powered False 02:36:47.354128 bus /sierra_3: Setting Powered False 02:36:48.469463 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:36:49.617537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:49.629892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:36:49.701373 tst mo_mt_call_osmux.py: using LAC 25398 02:36:49.828285 tst mo_mt_call_osmux.py: using RAC 153 02:36:49.954923 tst mo_mt_call_osmux.py: using CellId 25398 02:36:50.081778 tst mo_mt_call_osmux.py: using BVCI 25399 02:36:50.198830 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:50.210717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:50.222172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:50.233771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:50.245343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:50.256713 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:50.375601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:50.493346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:50.962907 run create_hlr_db(pid=14434): Launched 02:36:51.079271 bus /sierra_2: Setting Powered False 02:36:52.139659 run create_hlr_db(pid=14434): Terminated: ok {rc=0} 02:36:52.581368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14436): Launched 02:36:52.905660 run osmo-hlr_10.42.42.2(pid=14437): Launched 02:36:53.030016 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:53.591355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14439): Launched 02:36:53.915690 run osmo-stp_10.42.42.5(pid=14440): Launched 02:36:54.039339 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:54.622333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14442): Launched 02:36:54.945095 run osmo-msc_10.42.42.6(pid=14443): Launched 02:36:55.125212 run osmo-stp_10.42.42.5(pid=14440): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14440)] 02:36:55.262768 run osmo-stp_10.42.42.5(pid=14440): stdout: | (launched: 2022-12-10_02:36:53.855795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:55.399613 run osmo-stp_10.42.42.5(pid=14440): stderr: | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023654049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:55.535637 run osmo-stp_10.42.42.5(pid=14440): stdout: | (launched: 2022-12-10_02:36:53.855795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:55.663602 run osmo-stp_10.42.42.5(pid=14440): stderr: | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023654048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023654049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023654049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:55.816596 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14440): Process ended prematurely: osmo-stp_10.42.42.5(pid=14440) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14440)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:36:55.826226 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:36:55.853805 run osmo-hlr_10.42.42.2(pid=14437): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14437)] 02:36:55.904275 run osmo-hlr_10.42.42.2(pid=14437): stdout: | (launched: 2022-12-10_02:36:52.846555) 02:36:55.956233 run osmo-hlr_10.42.42.2(pid=14437): stderr: | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023653043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023653056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023653064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023653065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023653065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:56.027976 run osmo-msc_10.42.42.6(pid=14443): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14443)] 02:36:56.077585 run osmo-msc_10.42.42.6(pid=14443): stdout: | (launched: 2022-12-10_02:36:54.885985) 02:36:56.128792 run osmo-msc_10.42.42.6(pid=14443): stderr: | [0;m[38;5;43m20221210023655208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023655208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f410a3cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023655208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023655208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023655208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023655208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023655210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023655210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023655211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023655211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:56.180363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14436): Terminating (SIGTERM) 02:36:56.221473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14439): Terminating (SIGTERM) 02:36:56.262664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14442): Terminating (SIGTERM) 02:36:56.304239 --- ParallelTerminationStrategy: PID 14436 died... 02:36:56.324060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14436): Terminated: ok {rc=0} 02:36:56.369757 --- ParallelTerminationStrategy: PID 14439 died... 02:36:56.389086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14439): Terminated: ok {rc=0} 02:36:56.434441 --- ParallelTerminationStrategy: PID 14442 died... 02:36:56.453811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14442): Terminated: ok {rc=0} 02:36:56.540145 bus /sierra_3: Setting Powered False 02:36:57.637455 bus /sierra_3: Setting Powered False 02:36:58.753878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:37:00.004704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:00.011127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:37:00.044583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:37:00.070999 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:37:00.127027 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:37:00.161747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:37:00.189020 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:37:00.734607 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:37:00.784525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:00.795827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:00.872681 tst mo_mt_call.py: using LAC 25399 02:37:00.992759 tst mo_mt_call.py: using RAC 154 02:37:01.113708 tst mo_mt_call.py: using CellId 25399 02:37:01.233215 tst mo_mt_call.py: using BVCI 25400 02:37:01.347108 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:01.359296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:01.371423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:01.384520 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:01.398827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:01.410807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:01.539923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:01.687867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:02.178284 run create_hlr_db(pid=14448): Launched 02:37:02.302146 bus /sierra_2: Setting Powered False 02:37:03.362626 run create_hlr_db(pid=14448): Terminated: ok {rc=0} 02:37:03.803314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Launched 02:37:04.126829 run osmo-hlr_10.42.42.2(pid=14451): Launched 02:37:04.249826 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:04.802732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Launched 02:37:05.125569 run osmo-stp_10.42.42.5(pid=14454): Launched 02:37:05.249844 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:05.836925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Launched 02:37:06.161101 run osmo-msc_10.42.42.6(pid=14457): Launched 02:37:06.341568 run osmo-stp_10.42.42.5(pid=14454): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] 02:37:06.478058 run osmo-stp_10.42.42.5(pid=14454): stdout: | (launched: 2022-12-10_02:37:05.066702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:06.614755 run osmo-stp_10.42.42.5(pid=14454): stderr: | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023705261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:06.751481 run osmo-stp_10.42.42.5(pid=14454): stdout: | (launched: 2022-12-10_02:37:05.066702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:06.879496 run osmo-stp_10.42.42.5(pid=14454): stderr: | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023705260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023705261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023705261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:07.033622 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14454): Process ended prematurely: osmo-stp_10.42.42.5(pid=14454) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:37:07.042911 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:37:07.070314 run osmo-hlr_10.42.42.2(pid=14451): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14451)] 02:37:07.119737 run osmo-hlr_10.42.42.2(pid=14451): stdout: | (launched: 2022-12-10_02:37:04.068404) 02:37:07.171016 run osmo-hlr_10.42.42.2(pid=14451): stderr: | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023704268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023704280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023704288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023704289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023704289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:07.242442 run osmo-msc_10.42.42.6(pid=14457): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14457)] 02:37:07.291859 run osmo-msc_10.42.42.6(pid=14457): stdout: | (launched: 2022-12-10_02:37:06.102423) 02:37:07.343088 run osmo-msc_10.42.42.6(pid=14457): stderr: | [0;m[38;5;43m20221210023706426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023706426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10e0090c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023706426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023706426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023706426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023706426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023706428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023706429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023706429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023706429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:07.394505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Terminating (SIGTERM) 02:37:07.435723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Terminating (SIGTERM) 02:37:07.476870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Terminating (SIGTERM) 02:37:07.518683 --- ParallelTerminationStrategy: PID 14450 died... 02:37:07.538443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14450): Terminated: ok {rc=0} 02:37:07.584142 --- ParallelTerminationStrategy: PID 14453 died... 02:37:07.603657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14453): Terminated: ok {rc=0} 02:37:07.649270 --- ParallelTerminationStrategy: PID 14456 died... 02:37:07.668423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14456): Terminated: ok {rc=0} 02:37:07.755620 bus /sierra_3: Setting Powered False 02:37:08.854406 bus /sierra_3: Setting Powered False 02:37:09.971317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:37:11.121816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.134089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:11.210259 tst mo_mt_call_osmux.py: using LAC 25400 02:37:11.336249 tst mo_mt_call_osmux.py: using RAC 155 02:37:11.461192 tst mo_mt_call_osmux.py: using CellId 25400 02:37:11.585133 tst mo_mt_call_osmux.py: using BVCI 25401 02:37:11.702907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.714645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.726251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.737935 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.749580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:11.760940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:11.880280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:12.003858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:12.505104 run create_hlr_db(pid=14459): Launched 02:37:12.636474 bus /sierra_2: Setting Powered False 02:37:13.701150 run create_hlr_db(pid=14459): Terminated: ok {rc=0} 02:37:14.131716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14461): Launched 02:37:14.434889 run osmo-hlr_10.42.42.2(pid=14462): Launched 02:37:14.550857 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:15.075726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14464): Launched 02:37:15.379357 run osmo-stp_10.42.42.5(pid=14465): Launched 02:37:15.495867 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:16.057290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14467): Launched 02:37:16.377750 run osmo-msc_10.42.42.6(pid=14468): Launched 02:37:16.729501 run osmo-stp_10.42.42.5(pid=14465): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14465)] 02:37:16.888617 run osmo-stp_10.42.42.5(pid=14465): stdout: | (launched: 2022-12-10_02:37:15.323792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:17.138699 run osmo-stp_10.42.42.5(pid=14465): stderr: | [0;m[38;5;43m20221210023715492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023715492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023715493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023715493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023715493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023715493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023715494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:17.284837 run osmo-stp_10.42.42.5(pid=14465): stdout: | (launched: 2022-12-10_02:37:15.323792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:17.408362 run osmo-stp_10.42.42.5(pid=14465): stderr: | [0;m[38;5;43m20221210023715492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023715492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023715493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023715493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023715493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023715493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023715494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:17.558067 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14465): Process ended prematurely: osmo-stp_10.42.42.5(pid=14465) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14465)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:37:17.568558 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:37:17.595700 run osmo-hlr_10.42.42.2(pid=14462): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14462)] 02:37:17.643719 run osmo-hlr_10.42.42.2(pid=14462): stdout: | (launched: 2022-12-10_02:37:14.379883) 02:37:17.694282 run osmo-hlr_10.42.42.2(pid=14462): stderr: | [0;m[1;31m20221210023714555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023714555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023714556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023714556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023714556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023714556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023714567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023714576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023714576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023714576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:17.764442 run osmo-msc_10.42.42.6(pid=14468): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14468)] 02:37:17.812839 run osmo-msc_10.42.42.6(pid=14468): stdout: | (launched: 2022-12-10_02:37:16.312592) 02:37:17.862575 run osmo-msc_10.42.42.6(pid=14468): stderr: | [0;m[38;5;43m20221210023716904 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023716904 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8932d54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023716904 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023716904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023716904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023716905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023716914 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023716915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023716915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023716915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:17.912688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14461): Terminating (SIGTERM) 02:37:17.952598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14464): Terminating (SIGTERM) 02:37:17.992338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14467): Terminating (SIGTERM) 02:37:18.032422 --- ParallelTerminationStrategy: PID 14461 died... 02:37:18.051654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14461): Terminated: ok {rc=0} 02:37:18.096033 --- ParallelTerminationStrategy: PID 14464 died... 02:37:18.114569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14464): Terminated: ok {rc=0} 02:37:18.158644 --- ParallelTerminationStrategy: PID 14467 died... 02:37:18.177218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14467): Terminated: ok {rc=0} 02:37:18.263385 bus /sierra_3: Setting Powered False 02:37:19.363537 bus /sierra_3: Setting Powered False 02:37:20.482373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:37:21.738098 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:21.746532 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:37:21.781641 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:37:21.809211 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:37:21.866657 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:37:21.901433 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:37:21.929166 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:37:22.477884 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:37:22.530143 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:22.542088 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:37:22.612879 tst mo_mt_call.py: using LAC 25401 02:37:22.738197 tst mo_mt_call.py: using RAC 156 02:37:22.863182 tst mo_mt_call.py: using CellId 25401 02:37:22.992079 tst mo_mt_call.py: using BVCI 25402 02:37:23.109125 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:23.120771 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:23.132256 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:23.144000 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:23.155759 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:23.167452 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:23.284602 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:23.405155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:23.906814 run create_hlr_db(pid=14473): Launched 02:37:24.039141 bus /sierra_2: Setting Powered False 02:37:25.103177 run create_hlr_db(pid=14473): Terminated: ok {rc=0} 02:37:25.552060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14475): Launched 02:37:25.875346 run osmo-hlr_10.42.42.2(pid=14476): Launched 02:37:25.999108 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:26.552320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14478): Launched 02:37:26.875192 run osmo-stp_10.42.42.5(pid=14479): Launched 02:37:26.999402 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:27.583351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14481): Launched 02:37:27.907536 run osmo-msc_10.42.42.6(pid=14482): Launched 02:37:28.088744 run osmo-stp_10.42.42.5(pid=14479): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14479)] 02:37:28.225239 run osmo-stp_10.42.42.5(pid=14479): stdout: | (launched: 2022-12-10_02:37:26.816530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:28.362665 run osmo-stp_10.42.42.5(pid=14479): stderr: | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023727011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:28.498947 run osmo-stp_10.42.42.5(pid=14479): stdout: | (launched: 2022-12-10_02:37:26.816530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:28.627534 run osmo-stp_10.42.42.5(pid=14479): stderr: | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023727010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023727011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023727011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:28.781531 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14479): Process ended prematurely: osmo-stp_10.42.42.5(pid=14479) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14479)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:37:28.791069 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:37:28.818772 run osmo-hlr_10.42.42.2(pid=14476): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14476)] 02:37:28.868250 run osmo-hlr_10.42.42.2(pid=14476): stdout: | (launched: 2022-12-10_02:37:25.816851) 02:37:28.919839 run osmo-hlr_10.42.42.2(pid=14476): stderr: | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023726015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023726027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023726035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023726035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023726035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:28.991529 run osmo-msc_10.42.42.6(pid=14482): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14482)] 02:37:29.041228 run osmo-msc_10.42.42.6(pid=14482): stdout: | (launched: 2022-12-10_02:37:27.848558) 02:37:29.092517 run osmo-msc_10.42.42.6(pid=14482): stderr: | [0;m[38;5;43m20221210023728171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023728171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7197919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023728171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023728171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023728172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023728172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023728173 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023728174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023728174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023728174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:29.144220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14475): Terminating (SIGTERM) 02:37:29.185545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14478): Terminating (SIGTERM) 02:37:29.226983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14481): Terminating (SIGTERM) 02:37:29.268543 --- ParallelTerminationStrategy: PID 14475 died... 02:37:29.288461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14475): Terminated: ok {rc=0} 02:37:29.334731 --- ParallelTerminationStrategy: PID 14478 died... 02:37:29.354282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14478): Terminated: ok {rc=0} 02:37:29.399880 --- ParallelTerminationStrategy: PID 14481 died... 02:37:29.419361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14481): Terminated: ok {rc=0} 02:37:29.506400 bus /sierra_3: Setting Powered False 02:37:30.604546 bus /sierra_3: Setting Powered False 02:37:31.722092 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:37:32.881244 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:32.893529 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:37:32.967223 tst mo_mt_call_osmux.py: using LAC 25402 02:37:33.095691 tst mo_mt_call_osmux.py: using RAC 157 02:37:33.223012 tst mo_mt_call_osmux.py: using CellId 25402 02:37:33.351219 tst mo_mt_call_osmux.py: using BVCI 25403 02:37:33.468878 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.480792 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.492275 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.503819 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.515410 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.526892 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:33.646408 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:33.765438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:34.268121 run create_hlr_db(pid=14484): Launched 02:37:34.390982 bus /sierra_2: Setting Powered False 02:37:35.451210 run create_hlr_db(pid=14484): Terminated: ok {rc=0} 02:37:35.872924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Launched 02:37:36.181718 run osmo-hlr_10.42.42.2(pid=14488): Launched 02:37:36.297413 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:36.832702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14490): Launched 02:37:37.135861 run osmo-stp_10.42.42.5(pid=14491): Launched 02:37:37.251806 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:37.797468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14493): Launched 02:37:38.101522 run osmo-msc_10.42.42.6(pid=14494): Launched 02:37:38.272102 run osmo-stp_10.42.42.5(pid=14491): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14491)] 02:37:38.401394 run osmo-stp_10.42.42.5(pid=14491): stdout: | (launched: 2022-12-10_02:37:37.080706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:38.531122 run osmo-stp_10.42.42.5(pid=14491): stderr: | [0;m[38;5;43m20221210023737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023737250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023737250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023737250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:38.657981 run osmo-stp_10.42.42.5(pid=14491): stdout: | (launched: 2022-12-10_02:37:37.080706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:38.778600 run osmo-stp_10.42.42.5(pid=14491): stderr: | [0;m[38;5;43m20221210023737249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023737250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023737250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023737250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023737251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:38.922933 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14491): Process ended prematurely: osmo-stp_10.42.42.5(pid=14491) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14491)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:37:38.931791 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:37:38.958565 run osmo-hlr_10.42.42.2(pid=14488): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14488)] 02:37:39.006222 run osmo-hlr_10.42.42.2(pid=14488): stdout: | (launched: 2022-12-10_02:37:36.126554) 02:37:39.055424 run osmo-hlr_10.42.42.2(pid=14488): stderr: | [0;m[1;31m20221210023736304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023736304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023736304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023736304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023736305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023736305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023736316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023736326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023736326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023736326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:39.124235 run osmo-msc_10.42.42.6(pid=14494): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14494)] 02:37:39.171582 run osmo-msc_10.42.42.6(pid=14494): stdout: | (launched: 2022-12-10_02:37:38.045659) 02:37:39.220460 run osmo-msc_10.42.42.6(pid=14494): stderr: | [0;m[38;5;43m20221210023738318 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023738318 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42477ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023738318 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023738318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023738318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023738319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023738320 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023738321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023738321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023738321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:39.269991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Terminating (SIGTERM) 02:37:39.309402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14490): Terminating (SIGTERM) 02:37:39.349013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14493): Terminating (SIGTERM) 02:37:39.388715 --- ParallelTerminationStrategy: PID 14486 died... 02:37:39.407830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Terminated: ok {rc=0} 02:37:39.452095 --- ParallelTerminationStrategy: PID 14490 died... 02:37:39.470626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14490): Terminated: ok {rc=0} 02:37:39.515112 --- ParallelTerminationStrategy: PID 14493 died... 02:37:39.533681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14493): Terminated: ok {rc=0} 02:37:39.617129 bus /sierra_3: Setting Powered False 02:37:40.714208 bus /sierra_3: Setting Powered False 02:37:41.829637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:37:43.077223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:43.082689 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:37:43.116047 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:37:43.143124 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:37:43.199232 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:37:43.232717 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:37:43.259217 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:37:43.804224 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:37:43.853117 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:43.863967 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:37:43.936181 tst mo_mt_call.py: using LAC 25403 02:37:44.054041 tst mo_mt_call.py: using RAC 158 02:37:44.173159 tst mo_mt_call.py: using CellId 25403 02:37:44.289848 tst mo_mt_call.py: using BVCI 25404 02:37:44.399619 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:44.410617 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:44.421475 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:44.432633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:44.443814 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:44.454876 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:44.568833 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:44.683418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:45.150901 run create_hlr_db(pid=14499): Launched 02:37:45.266726 bus /sierra_2: Setting Powered False 02:37:46.325887 run create_hlr_db(pid=14499): Terminated: ok {rc=0} 02:37:46.758948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14501): Launched 02:37:47.086768 run osmo-hlr_10.42.42.2(pid=14502): Launched 02:37:47.300075 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:47.819705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14504): Launched 02:37:48.122909 run osmo-stp_10.42.42.5(pid=14505): Launched 02:37:48.238724 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:48.783935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14507): Launched 02:37:49.086663 run osmo-msc_10.42.42.6(pid=14508): Launched 02:37:49.256732 run osmo-stp_10.42.42.5(pid=14505): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14505)] 02:37:49.385777 run osmo-stp_10.42.42.5(pid=14505): stdout: | (launched: 2022-12-10_02:37:48.067795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:49.514876 run osmo-stp_10.42.42.5(pid=14505): stderr: | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023748237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:49.641553 run osmo-stp_10.42.42.5(pid=14505): stdout: | (launched: 2022-12-10_02:37:48.067795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:49.761635 run osmo-stp_10.42.42.5(pid=14505): stderr: | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023748236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023748237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023748237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:49.905507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14505): Process ended prematurely: osmo-stp_10.42.42.5(pid=14505) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14505)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:37:49.914732 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:37:49.942017 run osmo-hlr_10.42.42.2(pid=14502): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14502)] 02:37:49.989967 run osmo-hlr_10.42.42.2(pid=14502): stdout: | (launched: 2022-12-10_02:37:47.024467) 02:37:50.039608 run osmo-hlr_10.42.42.2(pid=14502): stderr: | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023747238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023747256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023747279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023747279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023747279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:50.108323 run osmo-msc_10.42.42.6(pid=14508): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14508)] 02:37:50.156037 run osmo-msc_10.42.42.6(pid=14508): stdout: | (launched: 2022-12-10_02:37:49.031596) 02:37:50.205413 run osmo-msc_10.42.42.6(pid=14508): stderr: | [0;m[38;5;43m20221210023749301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023749302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb227d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023749302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023749302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023749302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023749302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023749304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023749304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023749304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023749304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:50.255301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14501): Terminating (SIGTERM) 02:37:50.294796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14504): Terminating (SIGTERM) 02:37:50.334339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14507): Terminating (SIGTERM) 02:37:50.374168 --- ParallelTerminationStrategy: PID 14501 died... 02:37:50.393235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14501): Terminated: ok {rc=0} 02:37:50.437349 --- ParallelTerminationStrategy: PID 14504 died... 02:37:50.455741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14504): Terminated: ok {rc=0} 02:37:50.500082 --- ParallelTerminationStrategy: PID 14507 died... 02:37:50.518726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14507): Terminated: ok {rc=0} 02:37:50.604652 bus /sierra_3: Setting Powered False 02:37:51.704555 bus /sierra_3: Setting Powered False 02:37:52.820146 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:37:53.968395 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:53.980159 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:37:54.051905 tst mo_mt_call_osmux.py: using LAC 25404 02:37:54.173413 tst mo_mt_call_osmux.py: using RAC 159 02:37:54.295385 tst mo_mt_call_osmux.py: using CellId 25404 02:37:54.414391 tst mo_mt_call_osmux.py: using BVCI 25405 02:37:54.526226 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.537338 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.548206 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.559372 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.570675 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.581779 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:54.697903 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:54.821586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:55.325976 run create_hlr_db(pid=14510): Launched 02:37:55.458436 bus /sierra_2: Setting Powered False 02:37:56.519746 run create_hlr_db(pid=14510): Terminated: ok {rc=0} 02:37:56.967491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14512): Launched 02:37:57.292305 run osmo-hlr_10.42.42.2(pid=14513): Launched 02:37:57.415467 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:57.974338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14515): Launched 02:37:58.299337 run osmo-stp_10.42.42.5(pid=14516): Launched 02:37:58.423029 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:59.009578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14518): Launched 02:37:59.334327 run osmo-msc_10.42.42.6(pid=14519): Launched 02:37:59.514533 run osmo-stp_10.42.42.5(pid=14516): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14516)] 02:37:59.651502 run osmo-stp_10.42.42.5(pid=14516): stdout: | (launched: 2022-12-10_02:37:58.240760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:59.788281 run osmo-stp_10.42.42.5(pid=14516): stderr: | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023758435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:59.924472 run osmo-stp_10.42.42.5(pid=14516): stdout: | (launched: 2022-12-10_02:37:58.240760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:00.054233 run osmo-stp_10.42.42.5(pid=14516): stderr: | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023758434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023758435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023758435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:00.208189 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14516): Process ended prematurely: osmo-stp_10.42.42.5(pid=14516) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14516)] [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:38:00.217804 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:38:00.245938 run osmo-hlr_10.42.42.2(pid=14513): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14513)] 02:38:00.296243 run osmo-hlr_10.42.42.2(pid=14513): stdout: | (launched: 2022-12-10_02:37:57.232936) 02:38:00.348625 run osmo-hlr_10.42.42.2(pid=14513): stderr: | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023757433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023757445 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023757454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023757454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023757454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:00.421218 run osmo-msc_10.42.42.6(pid=14519): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14519)] 02:38:00.471433 run osmo-msc_10.42.42.6(pid=14519): stdout: | (launched: 2022-12-10_02:37:59.275332) 02:38:00.523523 run osmo-msc_10.42.42.6(pid=14519): stderr: | [0;m[38;5;43m20221210023759599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023759599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41e26dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023759599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023759599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023759599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023759599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023759601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023759602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023759602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023759602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:00.575714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14512): Terminating (SIGTERM) 02:38:00.617552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14515): Terminating (SIGTERM) 02:38:00.659258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14518): Terminating (SIGTERM) 02:38:00.701915 --- ParallelTerminationStrategy: PID 14512 died... 02:38:00.721982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14512): Terminated: ok {rc=0} 02:38:00.768328 --- ParallelTerminationStrategy: PID 14515 died... 02:38:00.787978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14515): Terminated: ok {rc=0} 02:38:00.849900 --- ParallelTerminationStrategy: PID 14518 died... 02:38:00.870554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14518): Terminated: ok {rc=0} 02:38:00.970430 bus /sierra_3: Setting Powered False 02:38:02.068090 bus /sierra_3: Setting Powered False 02:38:03.185815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 02:38:04.439194 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:04.443380 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:38:04.477098 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:38:04.503646 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:38:04.587382 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:38:04.620794 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:38:04.647116 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:38:05.232119 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 02:38:05.237083 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.247797 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:05.302754 tst emergency_mo_mt_call.py: using LAC 25405 02:38:05.429502 tst emergency_mo_mt_call.py: using RAC 160 02:38:05.552611 tst emergency_mo_mt_call.py: using CellId 25405 02:38:05.676484 tst emergency_mo_mt_call.py: using BVCI 25406 02:38:05.791269 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.802786 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.813787 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.824783 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.835922 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:05.847032 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:05.961858 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:06.079277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:06.569588 run create_hlr_db(pid=14525): Launched 02:38:06.699008 bus /sierra_2: Setting Powered False 02:38:07.761530 run create_hlr_db(pid=14525): Terminated: ok {rc=0} 02:38:08.204404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Launched 02:38:08.520660 run osmo-hlr_10.42.42.2(pid=14528): Launched 02:38:08.641223 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:09.185732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Launched 02:38:09.503511 run osmo-stp_10.42.42.5(pid=14531): Launched 02:38:09.634695 tst emergency_mo_mt_call.py: using MSISDN 7508 02:38:09.798753 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:10.370211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Launched 02:38:10.688191 run osmo-msc_10.42.42.6(pid=14534): Launched 02:38:10.864660 run osmo-stp_10.42.42.5(pid=14531): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] 02:38:10.998774 run osmo-stp_10.42.42.5(pid=14531): stdout: | (launched: 2022-12-10_02:38:09.446001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:11.132555 run osmo-stp_10.42.42.5(pid=14531): stderr: | [0;m[38;5;43m20221210023809638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023809639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023809639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023809639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:11.266638 run osmo-stp_10.42.42.5(pid=14531): stdout: | (launched: 2022-12-10_02:38:09.446001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:11.392548 run osmo-stp_10.42.42.5(pid=14531): stderr: | [0;m[38;5;43m20221210023809638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023809639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023809639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023809639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023809640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:11.543602 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14531): Process ended prematurely: osmo-stp_10.42.42.5(pid=14531) [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 02:38:11.552602 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 02:38:11.580036 run osmo-hlr_10.42.42.2(pid=14528): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14528)] 02:38:11.630334 run osmo-hlr_10.42.42.2(pid=14528): stdout: | (launched: 2022-12-10_02:38:08.463204) 02:38:11.682171 run osmo-hlr_10.42.42.2(pid=14528): stderr: | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023808661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023808674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023808682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023808682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023808682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:11.754427 run osmo-msc_10.42.42.6(pid=14534): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14534)] 02:38:11.804477 run osmo-msc_10.42.42.6(pid=14534): stdout: | (launched: 2022-12-10_02:38:10.630507) 02:38:11.856100 run osmo-msc_10.42.42.6(pid=14534): stderr: | [0;m[38;5;43m20221210023810955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023810955 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff68bf41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023810955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023810955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023810955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023810955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023810957 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023810958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023810958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023810958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:11.908048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Terminating (SIGTERM) 02:38:11.950112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Terminating (SIGTERM) 02:38:11.992055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Terminating (SIGTERM) 02:38:12.034128 --- ParallelTerminationStrategy: PID 14527 died... 02:38:12.054168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14527): Terminated: ok {rc=0} 02:38:12.100575 --- ParallelTerminationStrategy: PID 14530 died... 02:38:12.120583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14530): Terminated: ok {rc=0} 02:38:12.167003 --- ParallelTerminationStrategy: PID 14533 died... 02:38:12.186694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14533): Terminated: ok {rc=0} 02:38:12.274574 bus /sierra_3: Setting Powered False 02:38:13.372839 bus /sierra_3: Setting Powered False 02:38:14.488216 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 02:38:15.575905 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:15.587906 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:15.645066 tst emergency_preemptive_call.py: using LAC 25406 02:38:15.767850 tst emergency_preemptive_call.py: using RAC 161 02:38:15.896802 tst emergency_preemptive_call.py: using CellId 25406 02:38:16.024678 tst emergency_preemptive_call.py: using BVCI 25407 02:38:16.155600 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.171920 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.184884 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.203042 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.221383 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.236611 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.373433 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.511363 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.679584 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.819915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:17.334412 run create_hlr_db(pid=14587): Launched 02:38:17.504698 bus /sierra_2: Setting Powered False 02:38:18.586119 run create_hlr_db(pid=14587): Terminated: ok {rc=0} 02:38:19.085267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Launched 02:38:19.411852 run osmo-hlr_10.42.42.2(pid=14810): Launched 02:38:19.659735 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:20.321446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14812): Launched 02:38:20.655401 run osmo-stp_10.42.42.5(pid=14813): Launched 02:38:20.909826 tst emergency_preemptive_call.py: using MSISDN 7509 02:38:21.146006 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:21.700423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Launched 02:38:22.038257 run osmo-msc_10.42.42.6(pid=14818): Launched 02:38:22.394827 run osmo-stp_10.42.42.5(pid=14813): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14813)] 02:38:22.660531 run osmo-stp_10.42.42.5(pid=14813): stdout: | (launched: 2022-12-10_02:38:20.595206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:22.847283 run osmo-stp_10.42.42.5(pid=14813): stderr: | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023820895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:22.982794 run osmo-stp_10.42.42.5(pid=14813): stdout: | (launched: 2022-12-10_02:38:20.595206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:23.110753 run osmo-stp_10.42.42.5(pid=14813): stderr: | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023820894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023820895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023820895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:23.263889 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14813): Process ended prematurely: osmo-stp_10.42.42.5(pid=14813) [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14813)] [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 02:38:23.273806 tst emergency_preemptive_call.py:32: Test FAILED (7.7 sec) 02:38:23.303062 run osmo-hlr_10.42.42.2(pid=14810): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14810)] 02:38:23.355178 run osmo-hlr_10.42.42.2(pid=14810): stdout: | (launched: 2022-12-10_02:38:19.353665) 02:38:23.409106 run osmo-hlr_10.42.42.2(pid=14810): stderr: | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023819653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023819671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023819684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023819685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023819685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:23.483041 run osmo-msc_10.42.42.6(pid=14818): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14818)] 02:38:23.534347 run osmo-msc_10.42.42.6(pid=14818): stdout: | (launched: 2022-12-10_02:38:21.978255) 02:38:23.588133 run osmo-msc_10.42.42.6(pid=14818): stderr: | [0;m[38;5;43m20221210023822472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210023822477 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b6e390c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210023822477 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210023822477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210023822477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210023822477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210023822479 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210023822480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210023822480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210023822480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:23.642152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminating (SIGTERM) 02:38:23.685161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14812): Terminating (SIGTERM) 02:38:23.728456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Terminating (SIGTERM) 02:38:23.773960 --- ParallelTerminationStrategy: PID 14807 died... 02:38:23.794778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminated: ok {rc=0} 02:38:23.844199 --- ParallelTerminationStrategy: PID 14812 died... 02:38:23.865240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14812): Terminated: ok {rc=0} 02:38:23.914223 --- ParallelTerminationStrategy: PID 14817 died... 02:38:23.935092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Terminated: ok {rc=0} 02:38:24.026793 bus /sierra_9: Setting Powered False 02:38:25.131063 bus /sierra_9: Setting Powered False 02:38:26.250901 bus /sierra_8: Setting Powered False 02:38:27.353795 bus /sierra_8: Setting Powered False 02:38:28.471710 bus /sierra_3: Setting Powered False 02:38:29.574743 bus /sierra_3: Setting Powered False 02:38:30.697109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 02:38:32.059242 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:32.066847 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:38:32.123208 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 02:38:32.174531 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:38:32.288506 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:38:32.357337 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 02:38:32.410407 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:38:32.951771 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 02:38:33.006512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.018876 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:33.069318 tst cs_paging_gprs_active.py: using LAC 25407 02:38:33.192310 tst cs_paging_gprs_active.py: using RAC 162 02:38:33.314586 tst cs_paging_gprs_active.py: using CellId 25407 02:38:33.438067 tst cs_paging_gprs_active.py: using BVCI 25408 02:38:33.554303 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.566337 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.577934 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.591839 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.603257 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.615520 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.628340 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.641657 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:33.653362 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:33.778502 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:33.901815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:38:34.115162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:34.436685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14823): Launched 02:38:34.729296 run iperf3-srv_10.42.42.10(pid=14824): Launched 02:38:34.862791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:38:35.075199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:35.402293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Launched 02:38:35.696342 run iperf3-srv_10.42.42.10(pid=14826): Launched 02:38:35.832576 tst cs_paging_gprs_active.py:38: start network... 02:38:36.044026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:36.540637 run create_hlr_db(pid=14827): Launched 02:38:36.694936 bus /sierra_2: Setting Powered False 02:38:37.756849 run create_hlr_db(pid=14827): Terminated: ok {rc=0} 02:38:38.203311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14829): Launched 02:38:38.536355 run osmo-hlr_10.42.42.2(pid=14830): Launched 02:38:38.767980 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:39.294055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Launched 02:38:39.598516 run osmo-stp_10.42.42.5(pid=14834): Launched 02:38:39.715419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:38:40.237049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Launched 02:38:40.354955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:38:40.612506 run patchelf(pid=14837): Launched 02:38:40.782211 run osmo-stp_10.42.42.5(pid=14834): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] 02:38:40.911393 run osmo-stp_10.42.42.5(pid=14834): stdout: | (launched: 2022-12-10_02:38:39.542835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:41.041872 run osmo-stp_10.42.42.5(pid=14834): stderr: | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023839713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023839714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:41.172470 run osmo-stp_10.42.42.5(pid=14834): stdout: | (launched: 2022-12-10_02:38:39.542835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:41.297759 run osmo-stp_10.42.42.5(pid=14834): stderr: | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023839712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023839713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023839713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023839714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:41.445846 run patchelf(pid=14837): Terminating (SIGINT) 02:38:41.616300 run patchelf(pid=14837): Terminated: ok {rc=0} 02:38:41.740024 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14834): Process ended prematurely: osmo-stp_10.42.42.5(pid=14834) [trial-2368↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] [trial-2368↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 02:38:41.749494 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:38:41.777285 run osmo-hlr_10.42.42.2(pid=14830): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14830)] 02:38:41.826457 run osmo-hlr_10.42.42.2(pid=14830): stdout: | (launched: 2022-12-10_02:38:38.475376) 02:38:41.876506 run osmo-hlr_10.42.42.2(pid=14830): stderr: | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023838785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023838796 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023838804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023838804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023838804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:41.927343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14823): Terminating (SIGTERM) 02:38:41.967818 run iperf3-srv_10.42.42.10(pid=14824): Terminating (SIGTERM) 02:38:42.008094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Terminating (SIGTERM) 02:38:42.048636 run iperf3-srv_10.42.42.10(pid=14826): Terminating (SIGTERM) 02:38:42.088840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14829): Terminating (SIGTERM) 02:38:42.129302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Terminating (SIGTERM) 02:38:42.169876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Terminating (SIGTERM) 02:38:42.210445 --- ParallelTerminationStrategy: PID 14823 died... 02:38:42.229523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14823): Terminated: ok {rc=0} 02:38:42.274741 --- ParallelTerminationStrategy: PID 14824 died... 02:38:42.293268 run iperf3-srv_10.42.42.10(pid=14824): Terminated {rc=256} 02:38:42.338484 --- ParallelTerminationStrategy: PID 14825 died... 02:38:42.357305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Terminated: ok {rc=0} 02:38:42.402879 --- ParallelTerminationStrategy: PID 14826 died... 02:38:42.421410 run iperf3-srv_10.42.42.10(pid=14826): Terminated {rc=256} 02:38:42.466271 --- ParallelTerminationStrategy: PID 14829 died... 02:38:42.484754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14829): Terminated: ok {rc=0} 02:38:42.529773 --- ParallelTerminationStrategy: PID 14833 died... 02:38:42.548452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14833): Terminated: ok {rc=0} 02:38:42.594386 --- ParallelTerminationStrategy: PID 14836 died... 02:38:42.613231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14836): Terminated: ok {rc=0} 02:38:42.701790 bus /gobi_0: Setting Powered False 02:38:43.801747 bus /gobi_0: Setting Powered False 02:38:44.918063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 02:38:46.069182 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.081906 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:46.135589 tst iperf3.py: using LAC 25408 02:38:46.288221 tst iperf3.py: using RAC 163 02:38:46.419488 tst iperf3.py: using CellId 25408 02:38:46.542667 tst iperf3.py: using BVCI 25409 02:38:46.699888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.715817 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.731403 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.746502 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.761657 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.777877 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.793136 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.808633 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:46.824219 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:46.950886 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:38:47.162350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:47.480515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14838): Launched 02:38:47.746371 run iperf3-srv_10.42.42.10(pid=14839): Launched 02:38:47.860941 tst iperf3.py:8: start network... 02:38:48.064083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:48.534764 run create_hlr_db(pid=14840): Launched 02:38:48.650768 bus /gobi_6: Setting Powered False 02:38:49.710613 run create_hlr_db(pid=14840): Terminated: ok {rc=0} 02:38:50.132401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14842): Launched 02:38:50.436451 run osmo-hlr_10.42.42.2(pid=14843): Launched 02:38:50.553203 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:51.091298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14845): Launched 02:38:51.396364 run osmo-stp_10.42.42.5(pid=14846): Launched 02:38:51.513853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:38:52.039034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14848): Launched 02:38:52.155773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:38:52.412768 run patchelf(pid=14849): Launched 02:38:52.583424 run osmo-stp_10.42.42.5(pid=14846): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14846)] 02:38:52.712585 run osmo-stp_10.42.42.5(pid=14846): stdout: | (launched: 2022-12-10_02:38:51.340773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:52.842974 run osmo-stp_10.42.42.5(pid=14846): stderr: | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023851511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:52.973396 run osmo-stp_10.42.42.5(pid=14846): stdout: | (launched: 2022-12-10_02:38:51.340773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:53.098371 run osmo-stp_10.42.42.5(pid=14846): stderr: | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023851510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023851511 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023851511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:53.246779 run patchelf(pid=14849): Terminating (SIGINT) 02:38:53.418166 run patchelf(pid=14849): Terminated: ok {rc=0} 02:38:53.541414 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14846): Process ended prematurely: osmo-stp_10.42.42.5(pid=14846) [trial-2368↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14846)] [trial-2368↪gprs:trx-sysmocell5000↪iperf3.py:8] 02:38:53.550732 tst iperf3.py:8: Test FAILED (7.5 sec) 02:38:53.578597 run osmo-hlr_10.42.42.2(pid=14843): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14843)] 02:38:53.626985 run osmo-hlr_10.42.42.2(pid=14843): stdout: | (launched: 2022-12-10_02:38:50.380678) 02:38:53.677374 run osmo-hlr_10.42.42.2(pid=14843): stderr: | [0;m[1;31m20221210023850557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023850557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023850557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023850558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023850558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023850558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023850570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023850578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023850578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023850578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:53.728086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14838): Terminating (SIGTERM) 02:38:53.768914 run iperf3-srv_10.42.42.10(pid=14839): Terminating (SIGTERM) 02:38:53.809617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14842): Terminating (SIGTERM) 02:38:53.850244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14845): Terminating (SIGTERM) 02:38:53.890877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14848): Terminating (SIGTERM) 02:38:53.931874 --- ParallelTerminationStrategy: PID 14838 died... 02:38:53.951243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14838): Terminated: ok {rc=0} 02:38:53.996021 --- ParallelTerminationStrategy: PID 14839 died... 02:38:54.014762 run iperf3-srv_10.42.42.10(pid=14839): Terminated {rc=256} 02:38:54.059440 --- ParallelTerminationStrategy: PID 14842 died... 02:38:54.078157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14842): Terminated: ok {rc=0} 02:38:54.122336 --- ParallelTerminationStrategy: PID 14845 died... 02:38:54.140834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14845): Terminated: ok {rc=0} 02:38:54.185454 --- ParallelTerminationStrategy: PID 14848 died... 02:38:54.203917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14848): Terminated: ok {rc=0} 02:38:54.290418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 02:38:55.439635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:55.450855 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:55.501676 tst iperf3m4.py: using LAC 25409 02:38:55.630749 tst iperf3m4.py: using RAC 164 02:38:55.759127 tst iperf3m4.py: using CellId 25409 02:38:55.886408 tst iperf3m4.py: using BVCI 25410 02:38:56.005820 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.017281 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.028510 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.039912 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.051025 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.062169 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.073454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.084433 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:56.095829 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:56.212262 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:56.330882 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:56.450863 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:56.571866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:38:56.775086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:57.078559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14850): Launched 02:38:57.342496 run iperf3-srv_10.42.42.10(pid=14851): Launched 02:38:57.456482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:38:57.658484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:57.961074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14852): Launched 02:38:58.225218 run iperf3-srv_10.42.42.10(pid=14853): Launched 02:38:58.339409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:38:58.541934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:58.845482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14854): Launched 02:38:59.110025 run iperf3-srv_10.42.42.10(pid=14855): Launched 02:38:59.224127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:38:59.426130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:59.730066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Launched 02:38:59.993459 run iperf3-srv_10.42.42.10(pid=14857): Launched 02:39:00.108325 tst iperf3m4.py:8: start network... 02:39:00.311644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:00.783269 run create_hlr_db(pid=14858): Launched 02:39:00.902634 bus /gobi_6: Setting Powered False 02:39:01.962588 run create_hlr_db(pid=14858): Terminated: ok {rc=0} 02:39:02.394619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Launched 02:39:02.698455 run osmo-hlr_10.42.42.2(pid=14861): Launched 02:39:02.813747 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:03.334755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Launched 02:39:03.638976 run osmo-stp_10.42.42.5(pid=14864): Launched 02:39:03.755120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:04.277916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Launched 02:39:04.394326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:04.652590 run patchelf(pid=14867): Launched 02:39:04.822438 run osmo-stp_10.42.42.5(pid=14864): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] 02:39:04.951363 run osmo-stp_10.42.42.5(pid=14864): stdout: | (launched: 2022-12-10_02:39:03.583321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:05.081651 run osmo-stp_10.42.42.5(pid=14864): stderr: | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023903755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:05.212028 run osmo-stp_10.42.42.5(pid=14864): stdout: | (launched: 2022-12-10_02:39:03.583321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:05.337317 run osmo-stp_10.42.42.5(pid=14864): stderr: | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023903755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023903755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023903756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:05.485367 run patchelf(pid=14867): Terminating (SIGINT) 02:39:05.655729 run patchelf(pid=14867): Terminated: ok {rc=0} 02:39:05.778938 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14864): Process ended prematurely: osmo-stp_10.42.42.5(pid=14864) [trial-2368↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] [trial-2368↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 02:39:05.788247 tst iperf3m4.py:8: Test FAILED (10.4 sec) 02:39:05.816439 run osmo-hlr_10.42.42.2(pid=14861): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14861)] 02:39:05.864899 run osmo-hlr_10.42.42.2(pid=14861): stdout: | (launched: 2022-12-10_02:39:02.642721) 02:39:05.915072 run osmo-hlr_10.42.42.2(pid=14861): stderr: | [0;m[1;31m20221210023902820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023902820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023902820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023902820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023902821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023902821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023902832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023902841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023902841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023902841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:05.966213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14850): Terminating (SIGTERM) 02:39:06.006541 run iperf3-srv_10.42.42.10(pid=14851): Terminating (SIGTERM) 02:39:06.046837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14852): Terminating (SIGTERM) 02:39:06.087290 run iperf3-srv_10.42.42.10(pid=14853): Terminating (SIGTERM) 02:39:06.127659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14854): Terminating (SIGTERM) 02:39:06.167916 run iperf3-srv_10.42.42.10(pid=14855): Terminating (SIGTERM) 02:39:06.208194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Terminating (SIGTERM) 02:39:06.248553 run iperf3-srv_10.42.42.10(pid=14857): Terminating (SIGTERM) 02:39:06.288742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Terminating (SIGTERM) 02:39:06.329112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Terminating (SIGTERM) 02:39:06.369449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Terminating (SIGTERM) 02:39:06.410116 --- ParallelTerminationStrategy: PID 14850 died... 02:39:06.429574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14850): Terminated: ok {rc=0} 02:39:06.474521 --- ParallelTerminationStrategy: PID 14851 died... 02:39:06.493199 run iperf3-srv_10.42.42.10(pid=14851): Terminated {rc=256} 02:39:06.537584 --- ParallelTerminationStrategy: PID 14852 died... 02:39:06.556386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14852): Terminated: ok {rc=0} 02:39:06.601389 --- ParallelTerminationStrategy: PID 14853 died... 02:39:06.620002 run iperf3-srv_10.42.42.10(pid=14853): Terminated {rc=256} 02:39:06.664055 --- ParallelTerminationStrategy: PID 14854 died... 02:39:06.682577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14854): Terminated: ok {rc=0} 02:39:06.727122 --- ParallelTerminationStrategy: PID 14855 died... 02:39:06.745848 run iperf3-srv_10.42.42.10(pid=14855): Terminated {rc=256} 02:39:06.790240 --- ParallelTerminationStrategy: PID 14856 died... 02:39:06.808848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14856): Terminated: ok {rc=0} 02:39:06.853346 --- ParallelTerminationStrategy: PID 14857 died... 02:39:06.872160 run iperf3-srv_10.42.42.10(pid=14857): Terminated {rc=256} 02:39:06.916364 --- ParallelTerminationStrategy: PID 14860 died... 02:39:06.935033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14860): Terminated: ok {rc=0} 02:39:06.979394 --- ParallelTerminationStrategy: PID 14863 died... 02:39:06.998040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14863): Terminated: ok {rc=0} 02:39:07.042365 --- ParallelTerminationStrategy: PID 14866 died... 02:39:07.061176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14866): Terminated: ok {rc=0} 02:39:07.148340 bus /gobi_4: Setting Powered False 02:39:08.248704 bus /gobi_4: Setting Powered False 02:39:09.365017 bus /gobi_1: Setting Powered False 02:39:10.464140 bus /gobi_1: Setting Powered False 02:39:11.579382 bus /gobi_0: Setting Powered False 02:39:12.679226 bus /gobi_0: Setting Powered False 02:39:13.795923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 02:39:14.899820 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:14.911530 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:14.962586 tst ping.py: using LAC 25410 02:39:15.089100 tst ping.py: using RAC 165 02:39:15.213359 tst ping.py: using CellId 25410 02:39:15.338146 tst ping.py: using BVCI 25411 02:39:15.453680 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.464716 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.475884 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.486895 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.497902 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.508688 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.519782 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.530869 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:15.645772 tst ping.py:19: start network... 02:39:15.846582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:16.315886 run create_hlr_db(pid=14868): Launched 02:39:16.472678 bus /gobi_6: Setting Powered False 02:39:17.532651 run create_hlr_db(pid=14868): Terminated: ok {rc=0} 02:39:17.967038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Launched 02:39:18.284889 run osmo-hlr_10.42.42.2(pid=14871): Launched 02:39:18.406855 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:18.957718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Launched 02:39:19.276569 run osmo-stp_10.42.42.5(pid=14874): Launched 02:39:19.397763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:19.946842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14876): Launched 02:39:20.069922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:20.338448 run patchelf(pid=14877): Launched 02:39:20.516792 run osmo-stp_10.42.42.5(pid=14874): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] 02:39:20.652396 run osmo-stp_10.42.42.5(pid=14874): stdout: | (launched: 2022-12-10_02:39:19.218829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:20.790077 run osmo-stp_10.42.42.5(pid=14874): stderr: | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023919414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:20.927087 run osmo-stp_10.42.42.5(pid=14874): stdout: | (launched: 2022-12-10_02:39:19.218829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:21.058767 run osmo-stp_10.42.42.5(pid=14874): stderr: | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023919413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023919414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023919414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:21.213506 run patchelf(pid=14877): Terminating (SIGINT) 02:39:21.392305 run patchelf(pid=14877): Terminated: ok {rc=0} 02:39:21.521104 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14874): Process ended prematurely: osmo-stp_10.42.42.5(pid=14874) [trial-2368↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] [trial-2368↪gprs:trx-sysmocell5000↪ping.py:22] 02:39:21.530433 tst ping.py:22: Test FAILED (6.6 sec) 02:39:21.558604 run osmo-hlr_10.42.42.2(pid=14871): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14871)] 02:39:21.609352 run osmo-hlr_10.42.42.2(pid=14871): stdout: | (launched: 2022-12-10_02:39:18.227202) 02:39:21.661594 run osmo-hlr_10.42.42.2(pid=14871): stderr: | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023918424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023918437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023918445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023918445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023918445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:21.714170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminating (SIGTERM) 02:39:21.756887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Terminating (SIGTERM) 02:39:21.799200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14876): Terminating (SIGTERM) 02:39:21.841656 --- ParallelTerminationStrategy: PID 14870 died... 02:39:21.861760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14870): Terminated: ok {rc=0} 02:39:21.908870 --- ParallelTerminationStrategy: PID 14873 died... 02:39:21.929110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14873): Terminated: ok {rc=0} 02:39:21.976151 --- ParallelTerminationStrategy: PID 14876 died... 02:39:21.996104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14876): Terminated: ok {rc=0} 02:39:22.084780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 02:39:23.173146 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.185123 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:23.237919 tst ping_idle_ping.py: using LAC 25411 02:39:23.364835 tst ping_idle_ping.py: using RAC 166 02:39:23.483802 tst ping_idle_ping.py: using CellId 25411 02:39:23.603780 tst ping_idle_ping.py: using BVCI 25412 02:39:23.714653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.725680 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.736417 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.748006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.759229 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.770542 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.782023 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:23.793383 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:23.915480 tst ping_idle_ping.py:24: start network... 02:39:24.132052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:24.629709 run create_hlr_db(pid=14878): Launched 02:39:24.761321 bus /gobi_6: Setting Powered False 02:39:25.825192 run create_hlr_db(pid=14878): Terminated: ok {rc=0} 02:39:26.252479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14880): Launched 02:39:26.552575 run osmo-hlr_10.42.42.2(pid=14881): Launched 02:39:26.666844 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:27.179464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14883): Launched 02:39:27.477619 run osmo-stp_10.42.42.5(pid=14884): Launched 02:39:27.592882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:28.107334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14886): Launched 02:39:28.221971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:28.473367 run patchelf(pid=14887): Launched 02:39:28.640792 run osmo-stp_10.42.42.5(pid=14884): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14884)] 02:39:28.768040 run osmo-stp_10.42.42.5(pid=14884): stdout: | (launched: 2022-12-10_02:39:27.422986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:28.896628 run osmo-stp_10.42.42.5(pid=14884): stderr: | [0;m[38;5;43m20221210023927593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023927593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023927594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023927594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023927594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023927594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023927595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:29.025180 run osmo-stp_10.42.42.5(pid=14884): stdout: | (launched: 2022-12-10_02:39:27.422986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:29.147888 run osmo-stp_10.42.42.5(pid=14884): stderr: | [0;m[38;5;43m20221210023927593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023927593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023927594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023927594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023927594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023927594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023927595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:29.292764 run patchelf(pid=14887): Terminating (SIGINT) 02:39:29.461732 run patchelf(pid=14887): Terminated: ok {rc=0} 02:39:29.582882 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14884): Process ended prematurely: osmo-stp_10.42.42.5(pid=14884) [trial-2368↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14884)] [trial-2368↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 02:39:29.591623 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:39:29.618800 run osmo-hlr_10.42.42.2(pid=14881): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14881)] 02:39:29.666629 run osmo-hlr_10.42.42.2(pid=14881): stdout: | (launched: 2022-12-10_02:39:26.497575) 02:39:29.716142 run osmo-hlr_10.42.42.2(pid=14881): stderr: | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023926674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023926686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023926695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023926696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023926696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:29.766347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14880): Terminating (SIGTERM) 02:39:29.806446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14883): Terminating (SIGTERM) 02:39:29.846418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14886): Terminating (SIGTERM) 02:39:29.886563 --- ParallelTerminationStrategy: PID 14880 died... 02:39:29.905715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14880): Terminated: ok {rc=0} 02:39:29.950628 --- ParallelTerminationStrategy: PID 14883 died... 02:39:29.969426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14883): Terminated: ok {rc=0} 02:39:30.014105 --- ParallelTerminationStrategy: PID 14886 died... 02:39:30.033187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14886): Terminated: ok {rc=0} 02:39:30.118103 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 02:39:31.431690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:39:31.439269 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:39:31.475371 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:39:31.515903 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:39:31.603830 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:39:31.653338 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:39:31.703581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:39:32.277725 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:39:32.327593 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.338541 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:39:32.389319 tst cs_paging_gprs_active.py: using LAC 25412 02:39:32.520217 tst cs_paging_gprs_active.py: using RAC 167 02:39:32.641403 tst cs_paging_gprs_active.py: using CellId 25412 02:39:32.760770 tst cs_paging_gprs_active.py: using BVCI 25413 02:39:32.871515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.882511 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.893239 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.904137 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.914965 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.925900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.936795 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.947770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:32.958835 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:33.079822 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:33.197091 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:39:33.400864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:33.705234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14891): Launched 02:39:33.970019 run iperf3-srv_10.42.42.10(pid=14892): Launched 02:39:34.085247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:39:34.289105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:34.593919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Launched 02:39:34.859236 run iperf3-srv_10.42.42.10(pid=14894): Launched 02:39:34.974877 tst cs_paging_gprs_active.py:38: start network... 02:39:35.178420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:35.650142 run create_hlr_db(pid=14895): Launched 02:39:35.767347 bus /gobi_6: Setting Powered False 02:39:36.831965 run create_hlr_db(pid=14895): Terminated: ok {rc=0} 02:39:37.267305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Launched 02:39:37.572634 run osmo-hlr_10.42.42.2(pid=14898): Launched 02:39:37.689974 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:38.226768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Launched 02:39:38.532364 run osmo-stp_10.42.42.5(pid=14901): Launched 02:39:38.650020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:39.175584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Launched 02:39:39.292412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:39.549117 run patchelf(pid=14904): Launched 02:39:39.718735 run osmo-stp_10.42.42.5(pid=14901): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] 02:39:39.847492 run osmo-stp_10.42.42.5(pid=14901): stdout: | (launched: 2022-12-10_02:39:38.475619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:39.977936 run osmo-stp_10.42.42.5(pid=14901): stderr: | [0;m[38;5;43m20221210023938645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023938646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023938646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023938646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:40.108069 run osmo-stp_10.42.42.5(pid=14901): stdout: | (launched: 2022-12-10_02:39:38.475619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:40.233228 run osmo-stp_10.42.42.5(pid=14901): stderr: | [0;m[38;5;43m20221210023938645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023938646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023938646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023938646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023938647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:40.381600 run patchelf(pid=14904): Terminating (SIGINT) 02:39:40.551873 run patchelf(pid=14904): Terminated: ok {rc=0} 02:39:40.674994 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14901): Process ended prematurely: osmo-stp_10.42.42.5(pid=14901) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:39:40.684254 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 02:39:40.711404 run osmo-hlr_10.42.42.2(pid=14898): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14898)] 02:39:40.759812 run osmo-hlr_10.42.42.2(pid=14898): stdout: | (launched: 2022-12-10_02:39:37.516854) 02:39:40.809600 run osmo-hlr_10.42.42.2(pid=14898): stderr: | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023937695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023937708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023937717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023937717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023937717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:40.860095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14891): Terminating (SIGTERM) 02:39:40.900135 run iperf3-srv_10.42.42.10(pid=14892): Terminating (SIGTERM) 02:39:40.939926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Terminating (SIGTERM) 02:39:40.979972 run iperf3-srv_10.42.42.10(pid=14894): Terminating (SIGTERM) 02:39:41.019727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Terminating (SIGTERM) 02:39:41.059415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Terminating (SIGTERM) 02:39:41.099391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Terminating (SIGTERM) 02:39:41.139712 --- ParallelTerminationStrategy: PID 14891 died... 02:39:41.158900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14891): Terminated: ok {rc=0} 02:39:41.203300 --- ParallelTerminationStrategy: PID 14892 died... 02:39:41.221864 run iperf3-srv_10.42.42.10(pid=14892): Terminated {rc=256} 02:39:41.265929 --- ParallelTerminationStrategy: PID 14893 died... 02:39:41.284497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Terminated: ok {rc=0} 02:39:41.328569 --- ParallelTerminationStrategy: PID 14894 died... 02:39:41.347210 run iperf3-srv_10.42.42.10(pid=14894): Terminated {rc=256} 02:39:41.391384 --- ParallelTerminationStrategy: PID 14897 died... 02:39:41.409966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14897): Terminated: ok {rc=0} 02:39:41.454066 --- ParallelTerminationStrategy: PID 14900 died... 02:39:41.472505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14900): Terminated: ok {rc=0} 02:39:41.516721 --- ParallelTerminationStrategy: PID 14903 died... 02:39:41.535400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14903): Terminated: ok {rc=0} 02:39:41.619870 bus /gobi_0: Setting Powered False 02:39:42.718556 bus /gobi_0: Setting Powered False 02:39:43.834958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:39:44.984286 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:44.996403 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:39:45.052713 tst iperf3.py: using LAC 25413 02:39:45.181065 tst iperf3.py: using RAC 168 02:39:45.309266 tst iperf3.py: using CellId 25413 02:39:45.438090 tst iperf3.py: using BVCI 25414 02:39:45.555804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.567471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.578641 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.590597 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.602174 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.613720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.625234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.636586 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:45.648333 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:45.766067 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:45.972879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:46.289748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14905): Launched 02:39:46.577738 run iperf3-srv_10.42.42.10(pid=14906): Launched 02:39:46.702541 tst iperf3.py:8: start network... 02:39:46.910748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:47.390339 run create_hlr_db(pid=14907): Launched 02:39:47.509303 bus /gobi_6: Setting Powered False 02:39:48.569283 run create_hlr_db(pid=14907): Terminated: ok {rc=0} 02:39:49.013623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Launched 02:39:49.341073 run osmo-hlr_10.42.42.2(pid=14910): Launched 02:39:49.465738 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:50.027701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Launched 02:39:50.352056 run osmo-stp_10.42.42.5(pid=14913): Launched 02:39:50.475641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:51.037334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Launched 02:39:51.162373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:51.436900 run patchelf(pid=14916): Launched 02:39:51.618658 run osmo-stp_10.42.42.5(pid=14913): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] 02:39:51.756018 run osmo-stp_10.42.42.5(pid=14913): stdout: | (launched: 2022-12-10_02:39:50.292872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:51.895475 run osmo-stp_10.42.42.5(pid=14913): stderr: | [0;m[38;5;43m20221210023950487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023950487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023950488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023950488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:52.035618 run osmo-stp_10.42.42.5(pid=14913): stdout: | (launched: 2022-12-10_02:39:50.292872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:52.169588 run osmo-stp_10.42.42.5(pid=14913): stderr: | [0;m[38;5;43m20221210023950487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210023950487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210023950488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210023950488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210023950489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:52.327656 run patchelf(pid=14916): Terminating (SIGINT) 02:39:52.510467 run patchelf(pid=14916): Terminated: ok {rc=0} 02:39:52.641864 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14913): Process ended prematurely: osmo-stp_10.42.42.5(pid=14913) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 02:39:52.651927 tst iperf3.py:8: Test FAILED (7.7 sec) 02:39:52.680458 run osmo-hlr_10.42.42.2(pid=14910): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14910)] 02:39:52.730600 run osmo-hlr_10.42.42.2(pid=14910): stdout: | (launched: 2022-12-10_02:39:49.281649) 02:39:52.782562 run osmo-hlr_10.42.42.2(pid=14910): stderr: | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210023949481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210023949494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210023949504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210023949504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210023949504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:52.835172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14905): Terminating (SIGTERM) 02:39:52.878307 run iperf3-srv_10.42.42.10(pid=14906): Terminating (SIGTERM) 02:39:52.920826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Terminating (SIGTERM) 02:39:52.962949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Terminating (SIGTERM) 02:39:53.005357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Terminating (SIGTERM) 02:39:53.047531 --- ParallelTerminationStrategy: PID 14905 died... 02:39:53.067558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14905): Terminated: ok {rc=0} 02:39:53.114139 --- ParallelTerminationStrategy: PID 14906 died... 02:39:53.133692 run iperf3-srv_10.42.42.10(pid=14906): Terminated {rc=256} 02:39:53.179704 --- ParallelTerminationStrategy: PID 14909 died... 02:39:53.199237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Terminated: ok {rc=0} 02:39:53.245282 --- ParallelTerminationStrategy: PID 14912 died... 02:39:53.264718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Terminated: ok {rc=0} 02:39:53.310304 --- ParallelTerminationStrategy: PID 14915 died... 02:39:53.329712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Terminated: ok {rc=0} 02:39:53.415796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:39:54.566620 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:54.578614 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:39:54.631338 tst iperf3m4.py: using LAC 25414 02:39:54.758776 tst iperf3m4.py: using RAC 169 02:39:54.887863 tst iperf3m4.py: using CellId 25414 02:39:55.015844 tst iperf3m4.py: using BVCI 25415 02:39:55.134229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.145864 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.157269 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.168690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.180606 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.192042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.203537 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.215381 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.226924 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:55.342347 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:55.463360 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:55.582902 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:55.702260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:55.906875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:56.212629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14917): Launched 02:39:56.477789 run iperf3-srv_10.42.42.10(pid=14918): Launched 02:39:56.592827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:39:56.796015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:57.101342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14919): Launched 02:39:57.366128 run iperf3-srv_10.42.42.10(pid=14920): Launched 02:39:57.481692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:39:57.684294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:57.988697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Launched 02:39:58.254512 run iperf3-srv_10.42.42.10(pid=14922): Launched 02:39:58.369259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:39:58.571546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:58.876343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Launched 02:39:59.141744 run iperf3-srv_10.42.42.10(pid=14924): Launched 02:39:59.257175 tst iperf3m4.py:8: start network... 02:39:59.460538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:59.932417 run create_hlr_db(pid=14925): Launched 02:40:00.049371 bus /gobi_6: Setting Powered False 02:40:01.148694 run create_hlr_db(pid=14925): Terminated: ok {rc=0} 02:40:01.627142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Launched 02:40:01.952236 run osmo-hlr_10.42.42.2(pid=14931): Launched 02:40:02.195981 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:02.763679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Launched 02:40:03.090721 run osmo-stp_10.42.42.5(pid=14934): Launched 02:40:03.215037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:03.780163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Launched 02:40:03.904472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:04.178786 run patchelf(pid=14937): Launched 02:40:04.359854 run osmo-stp_10.42.42.5(pid=14934): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] 02:40:04.497493 run osmo-stp_10.42.42.5(pid=14934): stdout: | (launched: 2022-12-10_02:40:03.031527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:04.636280 run osmo-stp_10.42.42.5(pid=14934): stderr: | [0;m[38;5;43m20221210024003224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024003224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024003225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024003225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024003227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024003228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024003228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:04.775506 run osmo-stp_10.42.42.5(pid=14934): stdout: | (launched: 2022-12-10_02:40:03.031527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:04.909200 run osmo-stp_10.42.42.5(pid=14934): stderr: | [0;m[38;5;43m20221210024003224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024003224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024003225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024003225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024003227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024003228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024003228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:05.068335 run patchelf(pid=14937): Terminating (SIGINT) 02:40:05.251503 run patchelf(pid=14937): Terminated: ok {rc=0} 02:40:05.382902 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14934): Process ended prematurely: osmo-stp_10.42.42.5(pid=14934) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 02:40:05.393001 tst iperf3m4.py:8: Test FAILED (10.9 sec) 02:40:05.421977 run osmo-hlr_10.42.42.2(pid=14931): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14931)] 02:40:05.471931 run osmo-hlr_10.42.42.2(pid=14931): stdout: | (launched: 2022-12-10_02:40:01.886942) 02:40:05.523607 run osmo-hlr_10.42.42.2(pid=14931): stderr: | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024002219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024002232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024002240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024002240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024002240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:05.576156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14917): Terminating (SIGTERM) 02:40:05.618066 run iperf3-srv_10.42.42.10(pid=14918): Terminating (SIGTERM) 02:40:05.659831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14919): Terminating (SIGTERM) 02:40:05.701763 run iperf3-srv_10.42.42.10(pid=14920): Terminating (SIGTERM) 02:40:05.743377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Terminating (SIGTERM) 02:40:05.785666 run iperf3-srv_10.42.42.10(pid=14922): Terminating (SIGTERM) 02:40:05.827488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminating (SIGTERM) 02:40:05.869319 run iperf3-srv_10.42.42.10(pid=14924): Terminating (SIGTERM) 02:40:05.910956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Terminating (SIGTERM) 02:40:05.952742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Terminating (SIGTERM) 02:40:05.994856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Terminating (SIGTERM) 02:40:06.037104 --- ParallelTerminationStrategy: PID 14917 died... 02:40:06.056940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14917): Terminated: ok {rc=0} 02:40:06.103362 --- ParallelTerminationStrategy: PID 14918 died... 02:40:06.122931 run iperf3-srv_10.42.42.10(pid=14918): Terminated {rc=256} 02:40:06.168918 --- ParallelTerminationStrategy: PID 14919 died... 02:40:06.188515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14919): Terminated: ok {rc=0} 02:40:06.234600 --- ParallelTerminationStrategy: PID 14920 died... 02:40:06.254124 run iperf3-srv_10.42.42.10(pid=14920): Terminated {rc=256} 02:40:06.300251 --- ParallelTerminationStrategy: PID 14921 died... 02:40:06.319929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Terminated: ok {rc=0} 02:40:06.365936 --- ParallelTerminationStrategy: PID 14922 died... 02:40:06.385543 run iperf3-srv_10.42.42.10(pid=14922): Terminated {rc=256} 02:40:06.431542 --- ParallelTerminationStrategy: PID 14923 died... 02:40:06.451126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminated: ok {rc=0} 02:40:06.497225 --- ParallelTerminationStrategy: PID 14924 died... 02:40:06.516645 run iperf3-srv_10.42.42.10(pid=14924): Terminated {rc=256} 02:40:06.562912 --- ParallelTerminationStrategy: PID 14930 died... 02:40:06.582489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14930): Terminated: ok {rc=0} 02:40:06.628747 --- ParallelTerminationStrategy: PID 14933 died... 02:40:06.648416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14933): Terminated: ok {rc=0} 02:40:06.694483 --- ParallelTerminationStrategy: PID 14936 died... 02:40:06.714261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14936): Terminated: ok {rc=0} 02:40:06.802892 bus /gobi_4: Setting Powered False 02:40:07.903613 bus /gobi_4: Setting Powered False 02:40:09.022383 bus /gobi_1: Setting Powered False 02:40:10.121632 bus /gobi_1: Setting Powered False 02:40:11.234732 bus /gobi_0: Setting Powered False 02:40:12.332587 bus /gobi_0: Setting Powered False 02:40:13.449527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 02:40:14.552722 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:14.565072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:14.618428 tst ping.py: using LAC 25415 02:40:14.745314 tst ping.py: using RAC 170 02:40:14.870282 tst ping.py: using CellId 25415 02:40:14.996468 tst ping.py: using BVCI 25416 02:40:15.106573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.117726 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.128468 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.140103 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.151522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.162883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.174497 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.186122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:15.305147 tst ping.py:19: start network... 02:40:15.519858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:16.048753 run create_hlr_db(pid=14938): Launched 02:40:16.213288 bus /gobi_6: Setting Powered False 02:40:17.274211 run create_hlr_db(pid=14938): Terminated: ok {rc=0} 02:40:17.702028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Launched 02:40:17.999643 run osmo-hlr_10.42.42.2(pid=14941): Launched 02:40:18.112888 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:18.625681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Launched 02:40:18.924515 run osmo-stp_10.42.42.5(pid=14944): Launched 02:40:19.038477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:19.554307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Launched 02:40:19.669547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:19.921978 run patchelf(pid=14947): Launched 02:40:20.088883 run osmo-stp_10.42.42.5(pid=14944): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] 02:40:20.215077 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-10_02:40:18.870053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:20.342587 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221210024019040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024019040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024019041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024019041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024019043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024019044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024019044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:20.470938 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-10_02:40:18.870053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:20.592727 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221210024019040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024019040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024019041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024019041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024019043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024019044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024019044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:20.737272 run patchelf(pid=14947): Terminating (SIGINT) 02:40:20.905344 run patchelf(pid=14947): Terminated: ok {rc=0} 02:40:21.025857 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 02:40:21.034842 tst ping.py:22: Test FAILED (6.5 sec) 02:40:21.062461 run osmo-hlr_10.42.42.2(pid=14941): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14941)] 02:40:21.110927 run osmo-hlr_10.42.42.2(pid=14941): stdout: | (launched: 2022-12-10_02:40:17.945474) 02:40:21.160890 run osmo-hlr_10.42.42.2(pid=14941): stderr: | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024018119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024018158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024018168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024018168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024018168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:21.211177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminating (SIGTERM) 02:40:21.251166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminating (SIGTERM) 02:40:21.291475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminating (SIGTERM) 02:40:21.332388 --- ParallelTerminationStrategy: PID 14940 died... 02:40:21.351773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminated: ok {rc=0} 02:40:21.397019 --- ParallelTerminationStrategy: PID 14943 died... 02:40:21.416055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminated: ok {rc=0} 02:40:21.461242 --- ParallelTerminationStrategy: PID 14946 died... 02:40:21.480134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminated: ok {rc=0} 02:40:21.566580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:40:22.655002 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:22.667209 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:22.719070 tst ping_idle_ping.py: using LAC 25416 02:40:22.835993 tst ping_idle_ping.py: using RAC 171 02:40:22.952847 tst ping_idle_ping.py: using CellId 25416 02:40:23.070365 tst ping_idle_ping.py: using BVCI 25417 02:40:23.188716 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.200508 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.211900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.223138 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.234562 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.245915 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.257617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:23.268766 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:23.384488 tst ping_idle_ping.py:24: start network... 02:40:23.585157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:24.049168 run create_hlr_db(pid=14948): Launched 02:40:24.164419 bus /gobi_6: Setting Powered False 02:40:25.223514 run create_hlr_db(pid=14948): Terminated: ok {rc=0} 02:40:25.660346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14950): Launched 02:40:25.979526 run osmo-hlr_10.42.42.2(pid=14951): Launched 02:40:26.102373 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:26.649673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14953): Launched 02:40:26.968604 run osmo-stp_10.42.42.5(pid=14954): Launched 02:40:27.090760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:27.641984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14956): Launched 02:40:27.764593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:28.034337 run patchelf(pid=14957): Launched 02:40:28.213193 run osmo-stp_10.42.42.5(pid=14954): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14954)] 02:40:28.348400 run osmo-stp_10.42.42.5(pid=14954): stdout: | (launched: 2022-12-10_02:40:26.910277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:28.485489 run osmo-stp_10.42.42.5(pid=14954): stderr: | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024027102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:28.622719 run osmo-stp_10.42.42.5(pid=14954): stdout: | (launched: 2022-12-10_02:40:26.910277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:28.755402 run osmo-stp_10.42.42.5(pid=14954): stderr: | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024027101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024027102 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024027102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:28.911016 run patchelf(pid=14957): Terminating (SIGINT) 02:40:29.090848 run patchelf(pid=14957): Terminated: ok {rc=0} 02:40:29.220144 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14954): Process ended prematurely: osmo-stp_10.42.42.5(pid=14954) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14954)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 02:40:29.229623 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:40:29.257681 run osmo-hlr_10.42.42.2(pid=14951): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14951)] 02:40:29.307470 run osmo-hlr_10.42.42.2(pid=14951): stdout: | (launched: 2022-12-10_02:40:25.921415) 02:40:29.359014 run osmo-hlr_10.42.42.2(pid=14951): stderr: | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024026119 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024026131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024026139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024026139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024026140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:29.411062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14950): Terminating (SIGTERM) 02:40:29.452733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14953): Terminating (SIGTERM) 02:40:29.494625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14956): Terminating (SIGTERM) 02:40:29.536703 --- ParallelTerminationStrategy: PID 14950 died... 02:40:29.556739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14950): Terminated: ok {rc=0} 02:40:29.602739 --- ParallelTerminationStrategy: PID 14953 died... 02:40:29.622375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14953): Terminated: ok {rc=0} 02:40:29.668426 --- ParallelTerminationStrategy: PID 14956 died... 02:40:29.687984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14956): Terminated: ok {rc=0} 02:40:29.774913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:40:31.130072 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:40:31.139666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:40:31.184929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:40:31.236423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:40:31.345769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:40:31.392587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:40:31.443761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:40:32.041380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:40:32.114480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.132113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:40:32.221748 tst cs_paging_gprs_active.py: using LAC 25417 02:40:32.353409 tst cs_paging_gprs_active.py: using RAC 172 02:40:32.481348 tst cs_paging_gprs_active.py: using CellId 25417 02:40:32.609298 tst cs_paging_gprs_active.py: using BVCI 25418 02:40:32.727731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.739301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.750763 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.762422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.774021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.785545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.797219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.808417 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:32.820050 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:32.937615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:33.057453 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:40:33.262473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:33.567419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14961): Launched 02:40:33.835124 run iperf3-srv_10.42.42.10(pid=14962): Launched 02:40:33.951127 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:40:34.155244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:34.460649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14963): Launched 02:40:34.725586 run iperf3-srv_10.42.42.10(pid=14964): Launched 02:40:34.840837 tst cs_paging_gprs_active.py:38: start network... 02:40:35.045236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:35.518350 run create_hlr_db(pid=14965): Launched 02:40:35.636821 bus /gobi_6: Setting Powered False 02:40:36.697520 run create_hlr_db(pid=14965): Terminated: ok {rc=0} 02:40:37.141778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Launched 02:40:37.467997 run osmo-hlr_10.42.42.2(pid=14968): Launched 02:40:37.593956 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:38.152465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Launched 02:40:38.478127 run osmo-stp_10.42.42.5(pid=14971): Launched 02:40:38.603529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:39.163579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Launched 02:40:39.288814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:39.563760 run patchelf(pid=14974): Launched 02:40:39.744777 run osmo-stp_10.42.42.5(pid=14971): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] 02:40:39.882771 run osmo-stp_10.42.42.5(pid=14971): stdout: | (launched: 2022-12-10_02:40:38.419152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:40.022750 run osmo-stp_10.42.42.5(pid=14971): stderr: | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024038613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024038613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024038613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024038614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:40.162149 run osmo-stp_10.42.42.5(pid=14971): stdout: | (launched: 2022-12-10_02:40:38.419152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:40.295613 run osmo-stp_10.42.42.5(pid=14971): stderr: | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024038612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024038613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024038613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024038613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024038614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:40.454145 run patchelf(pid=14974): Terminating (SIGINT) 02:40:40.636160 run patchelf(pid=14974): Terminated: ok {rc=0} 02:40:40.767681 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14971): Process ended prematurely: osmo-stp_10.42.42.5(pid=14971) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:40:40.777691 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:40:40.806039 run osmo-hlr_10.42.42.2(pid=14968): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14968)] 02:40:40.856093 run osmo-hlr_10.42.42.2(pid=14968): stdout: | (launched: 2022-12-10_02:40:37.408757) 02:40:40.907704 run osmo-hlr_10.42.42.2(pid=14968): stderr: | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024037611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024037644 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024037654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024037655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024037655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:40.959705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14961): Terminating (SIGTERM) 02:40:41.001390 run iperf3-srv_10.42.42.10(pid=14962): Terminating (SIGTERM) 02:40:41.043296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14963): Terminating (SIGTERM) 02:40:41.085056 run iperf3-srv_10.42.42.10(pid=14964): Terminating (SIGTERM) 02:40:41.127439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Terminating (SIGTERM) 02:40:41.169535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Terminating (SIGTERM) 02:40:41.209587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Terminating (SIGTERM) 02:40:41.249797 --- ParallelTerminationStrategy: PID 14961 died... 02:40:41.269235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14961): Terminated: ok {rc=0} 02:40:41.313690 --- ParallelTerminationStrategy: PID 14962 died... 02:40:41.332440 run iperf3-srv_10.42.42.10(pid=14962): Terminated {rc=256} 02:40:41.376310 --- ParallelTerminationStrategy: PID 14963 died... 02:40:41.394807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14963): Terminated: ok {rc=0} 02:40:41.438743 --- ParallelTerminationStrategy: PID 14964 died... 02:40:41.457191 run iperf3-srv_10.42.42.10(pid=14964): Terminated {rc=256} 02:40:41.501201 --- ParallelTerminationStrategy: PID 14967 died... 02:40:41.519345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Terminated: ok {rc=0} 02:40:41.563319 --- ParallelTerminationStrategy: PID 14970 died... 02:40:41.581923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Terminated: ok {rc=0} 02:40:41.625721 --- ParallelTerminationStrategy: PID 14973 died... 02:40:41.644176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Terminated: ok {rc=0} 02:40:41.728211 bus /gobi_0: Setting Powered False 02:40:42.826344 bus /gobi_0: Setting Powered False 02:40:43.944836 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:40:45.095630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.107875 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:40:45.182768 tst iperf3.py: using LAC 25418 02:40:45.312723 tst iperf3.py: using RAC 173 02:40:45.441356 tst iperf3.py: using CellId 25418 02:40:45.561864 tst iperf3.py: using BVCI 25419 02:40:45.674854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.686076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.697178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.708871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.720658 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.732688 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.744148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.755685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:45.767342 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:45.895038 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:46.120889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:46.457751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14975): Launched 02:40:46.761812 run iperf3-srv_10.42.42.10(pid=14976): Launched 02:40:46.900457 tst iperf3.py:8: start network... 02:40:47.123894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:47.632141 run create_hlr_db(pid=14977): Launched 02:40:47.765582 bus /gobi_6: Setting Powered False 02:40:48.829430 run create_hlr_db(pid=14977): Terminated: ok {rc=0} 02:40:49.281698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Launched 02:40:49.607951 run osmo-hlr_10.42.42.2(pid=14980): Launched 02:40:49.732365 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:50.296475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Launched 02:40:50.621721 run osmo-stp_10.42.42.5(pid=14983): Launched 02:40:50.746634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:51.308645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14985): Launched 02:40:51.434067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:51.708166 run patchelf(pid=14986): Launched 02:40:51.889266 run osmo-stp_10.42.42.5(pid=14983): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] 02:40:52.027185 run osmo-stp_10.42.42.5(pid=14983): stdout: | (launched: 2022-12-10_02:40:50.562804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:52.166369 run osmo-stp_10.42.42.5(pid=14983): stderr: | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024050757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:52.305644 run osmo-stp_10.42.42.5(pid=14983): stdout: | (launched: 2022-12-10_02:40:50.562804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:52.439399 run osmo-stp_10.42.42.5(pid=14983): stderr: | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024050756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024050757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024050757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:52.597853 run patchelf(pid=14986): Terminating (SIGINT) 02:40:52.780710 run patchelf(pid=14986): Terminated: ok {rc=0} 02:40:52.912328 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14983): Process ended prematurely: osmo-stp_10.42.42.5(pid=14983) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 02:40:52.922422 tst iperf3.py:8: Test FAILED (7.9 sec) 02:40:52.951067 run osmo-hlr_10.42.42.2(pid=14980): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14980)] 02:40:53.001317 run osmo-hlr_10.42.42.2(pid=14980): stdout: | (launched: 2022-12-10_02:40:49.549133) 02:40:53.053408 run osmo-hlr_10.42.42.2(pid=14980): stderr: | [0;m[1;31m20221210024049750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024049751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024049751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024049751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024049751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024049751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024049763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024049772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024049772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024049772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:53.106077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14975): Terminating (SIGTERM) 02:40:53.147950 run iperf3-srv_10.42.42.10(pid=14976): Terminating (SIGTERM) 02:40:53.190046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Terminating (SIGTERM) 02:40:53.232160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Terminating (SIGTERM) 02:40:53.274335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14985): Terminating (SIGTERM) 02:40:53.316444 --- ParallelTerminationStrategy: PID 14975 died... 02:40:53.336613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14975): Terminated: ok {rc=0} 02:40:53.383455 --- ParallelTerminationStrategy: PID 14976 died... 02:40:53.403430 run iperf3-srv_10.42.42.10(pid=14976): Terminated {rc=256} 02:40:53.449775 --- ParallelTerminationStrategy: PID 14979 died... 02:40:53.469541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14979): Terminated: ok {rc=0} 02:40:53.515810 --- ParallelTerminationStrategy: PID 14982 died... 02:40:53.535530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14982): Terminated: ok {rc=0} 02:40:53.581913 --- ParallelTerminationStrategy: PID 14985 died... 02:40:53.601648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14985): Terminated: ok {rc=0} 02:40:53.689469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:40:54.840740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:54.853155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:40:54.925807 tst iperf3m4.py: using LAC 25419 02:40:55.056514 tst iperf3m4.py: using RAC 174 02:40:55.187284 tst iperf3m4.py: using CellId 25419 02:40:55.315231 tst iperf3m4.py: using BVCI 25420 02:40:55.434290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.445983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.457309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.468693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.480137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.491627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.503364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.514729 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:55.526599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:55.647174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:55.768078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:55.884745 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:56.005646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:56.226235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:56.553079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Launched 02:40:56.836595 run iperf3-srv_10.42.42.10(pid=14988): Launched 02:40:56.959201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:40:57.179889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:57.507181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14989): Launched 02:40:57.790143 run iperf3-srv_10.42.42.10(pid=14990): Launched 02:40:57.913333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:40:58.132527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:58.457910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14991): Launched 02:40:58.740151 run iperf3-srv_10.42.42.10(pid=14992): Launched 02:40:58.862719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:40:59.082194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:59.407495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14993): Launched 02:40:59.691242 run iperf3-srv_10.42.42.10(pid=14994): Launched 02:40:59.813499 tst iperf3m4.py:8: start network... 02:41:00.031971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:00.536879 run create_hlr_db(pid=14995): Launched 02:41:00.669758 bus /gobi_6: Setting Powered False 02:41:01.734784 run create_hlr_db(pid=14995): Terminated: ok {rc=0} 02:41:02.205726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Launched 02:41:02.537541 run osmo-hlr_10.42.42.2(pid=14998): Launched 02:41:02.662975 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:03.223037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Launched 02:41:03.548055 run osmo-stp_10.42.42.5(pid=15001): Launched 02:41:03.673292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:04.233162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15003): Launched 02:41:04.357616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:04.633303 run patchelf(pid=15004): Launched 02:41:04.814372 run osmo-stp_10.42.42.5(pid=15001): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] 02:41:04.951498 run osmo-stp_10.42.42.5(pid=15001): stdout: | (launched: 2022-12-10_02:41:03.488794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:05.090889 run osmo-stp_10.42.42.5(pid=15001): stderr: | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024103682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:05.229689 run osmo-stp_10.42.42.5(pid=15001): stdout: | (launched: 2022-12-10_02:41:03.488794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:05.363096 run osmo-stp_10.42.42.5(pid=15001): stderr: | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024103681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024103682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024103682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:05.521268 run patchelf(pid=15004): Terminating (SIGINT) 02:41:05.703278 run patchelf(pid=15004): Terminated: ok {rc=0} 02:41:05.833844 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15001): Process ended prematurely: osmo-stp_10.42.42.5(pid=15001) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:41:05.843919 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:41:05.872828 run osmo-hlr_10.42.42.2(pid=14998): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14998)] 02:41:05.922985 run osmo-hlr_10.42.42.2(pid=14998): stdout: | (launched: 2022-12-10_02:41:02.478205) 02:41:05.974982 run osmo-hlr_10.42.42.2(pid=14998): stderr: | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024102676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024102716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024102725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:06.027742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Terminating (SIGTERM) 02:41:06.069811 run iperf3-srv_10.42.42.10(pid=14988): Terminating (SIGTERM) 02:41:06.112066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14989): Terminating (SIGTERM) 02:41:06.154294 run iperf3-srv_10.42.42.10(pid=14990): Terminating (SIGTERM) 02:41:06.195988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14991): Terminating (SIGTERM) 02:41:06.238006 run iperf3-srv_10.42.42.10(pid=14992): Terminating (SIGTERM) 02:41:06.279647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14993): Terminating (SIGTERM) 02:41:06.321659 run iperf3-srv_10.42.42.10(pid=14994): Terminating (SIGTERM) 02:41:06.363362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Terminating (SIGTERM) 02:41:06.405157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Terminating (SIGTERM) 02:41:06.446828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15003): Terminating (SIGTERM) 02:41:06.489098 --- ParallelTerminationStrategy: PID 14987 died... 02:41:06.509207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14987): Terminated: ok {rc=0} 02:41:06.555678 --- ParallelTerminationStrategy: PID 14988 died... 02:41:06.575235 run iperf3-srv_10.42.42.10(pid=14988): Terminated {rc=256} 02:41:06.621214 --- ParallelTerminationStrategy: PID 14989 died... 02:41:06.640669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14989): Terminated: ok {rc=0} 02:41:06.686992 --- ParallelTerminationStrategy: PID 14990 died... 02:41:06.706345 run iperf3-srv_10.42.42.10(pid=14990): Terminated {rc=256} 02:41:06.752336 --- ParallelTerminationStrategy: PID 14991 died... 02:41:06.771998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14991): Terminated: ok {rc=0} 02:41:06.817832 --- ParallelTerminationStrategy: PID 14992 died... 02:41:06.837434 run iperf3-srv_10.42.42.10(pid=14992): Terminated {rc=256} 02:41:06.883213 --- ParallelTerminationStrategy: PID 14993 died... 02:41:06.902837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14993): Terminated: ok {rc=0} 02:41:06.948706 --- ParallelTerminationStrategy: PID 14994 died... 02:41:06.968313 run iperf3-srv_10.42.42.10(pid=14994): Terminated {rc=256} 02:41:07.014227 --- ParallelTerminationStrategy: PID 14997 died... 02:41:07.033910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14997): Terminated: ok {rc=0} 02:41:07.080245 --- ParallelTerminationStrategy: PID 15000 died... 02:41:07.099939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15000): Terminated: ok {rc=0} 02:41:07.146017 --- ParallelTerminationStrategy: PID 15003 died... 02:41:07.165868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15003): Terminated: ok {rc=0} 02:41:07.254249 bus /gobi_4: Setting Powered False 02:41:08.354522 bus /gobi_4: Setting Powered False 02:41:09.470174 bus /gobi_1: Setting Powered False 02:41:10.569395 bus /gobi_1: Setting Powered False 02:41:11.685556 bus /gobi_0: Setting Powered False 02:41:12.784149 bus /gobi_0: Setting Powered False 02:41:13.902569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:41:15.005638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.017377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:15.087923 tst ping.py: using LAC 25420 02:41:15.208050 tst ping.py: using RAC 175 02:41:15.325724 tst ping.py: using CellId 25420 02:41:15.443013 tst ping.py: using BVCI 25421 02:41:15.551295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.562616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.573641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.584873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.595916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.606992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.618290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.629532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:15.744871 tst ping.py:19: start network... 02:41:15.960774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:16.430867 run create_hlr_db(pid=15005): Launched 02:41:16.581588 bus /gobi_6: Setting Powered False 02:41:17.640533 run create_hlr_db(pid=15005): Terminated: ok {rc=0} 02:41:18.075886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Launched 02:41:18.394144 run osmo-hlr_10.42.42.2(pid=15008): Launched 02:41:18.514901 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:19.071417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Launched 02:41:19.389306 run osmo-stp_10.42.42.5(pid=15011): Launched 02:41:19.509993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:20.059805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15013): Launched 02:41:20.181888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:20.450444 run patchelf(pid=15014): Launched 02:41:20.628133 run osmo-stp_10.42.42.5(pid=15011): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] 02:41:20.762696 run osmo-stp_10.42.42.5(pid=15011): stdout: | (launched: 2022-12-10_02:41:19.331569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:20.898854 run osmo-stp_10.42.42.5(pid=15011): stderr: | [0;m[38;5;43m20221210024119523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024119523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024119524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024119524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024119524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024119524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024119525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:21.035385 run osmo-stp_10.42.42.5(pid=15011): stdout: | (launched: 2022-12-10_02:41:19.331569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:21.165655 run osmo-stp_10.42.42.5(pid=15011): stderr: | [0;m[38;5;43m20221210024119523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024119523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024119524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024119524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024119524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024119524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024119525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:21.319758 run patchelf(pid=15014): Terminating (SIGINT) 02:41:21.498351 run patchelf(pid=15014): Terminated: ok {rc=0} 02:41:21.627071 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15011): Process ended prematurely: osmo-stp_10.42.42.5(pid=15011) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 02:41:21.636510 tst ping.py:22: Test FAILED (6.6 sec) 02:41:21.664639 run osmo-hlr_10.42.42.2(pid=15008): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15008)] 02:41:21.714461 run osmo-hlr_10.42.42.2(pid=15008): stdout: | (launched: 2022-12-10_02:41:18.336489) 02:41:21.766131 run osmo-hlr_10.42.42.2(pid=15008): stderr: | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024118536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024118548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024118557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024118557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024118557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:21.818158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Terminating (SIGTERM) 02:41:21.859610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Terminating (SIGTERM) 02:41:21.901396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15013): Terminating (SIGTERM) 02:41:21.943422 --- ParallelTerminationStrategy: PID 15007 died... 02:41:21.963314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Terminated: ok {rc=0} 02:41:22.009457 --- ParallelTerminationStrategy: PID 15010 died... 02:41:22.029310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Terminated: ok {rc=0} 02:41:22.075707 --- ParallelTerminationStrategy: PID 15013 died... 02:41:22.095333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15013): Terminated: ok {rc=0} 02:41:22.183909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:41:23.271789 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.283947 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:23.357221 tst ping_idle_ping.py: using LAC 25421 02:41:23.481737 tst ping_idle_ping.py: using RAC 176 02:41:23.600838 tst ping_idle_ping.py: using CellId 25421 02:41:23.718412 tst ping_idle_ping.py: using BVCI 25422 02:41:23.834630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.846307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.857592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.868857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.880071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.891401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.902778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:23.914049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:24.030514 tst ping_idle_ping.py:24: start network... 02:41:24.246180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:24.748147 run create_hlr_db(pid=15015): Launched 02:41:24.878239 bus /gobi_6: Setting Powered False 02:41:25.941588 run create_hlr_db(pid=15015): Terminated: ok {rc=0} 02:41:26.370140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15017): Launched 02:41:26.669435 run osmo-hlr_10.42.42.2(pid=15018): Launched 02:41:26.784521 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:27.314775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15020): Launched 02:41:27.613351 run osmo-stp_10.42.42.5(pid=15021): Launched 02:41:27.727526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:28.240428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15023): Launched 02:41:28.356206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:28.608481 run patchelf(pid=15024): Launched 02:41:28.776352 run osmo-stp_10.42.42.5(pid=15021): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15021)] 02:41:28.903492 run osmo-stp_10.42.42.5(pid=15021): stdout: | (launched: 2022-12-10_02:41:27.558699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:29.032170 run osmo-stp_10.42.42.5(pid=15021): stderr: | [0;m[38;5;43m20221210024127729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024127729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024127730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024127730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:29.161213 run osmo-stp_10.42.42.5(pid=15021): stdout: | (launched: 2022-12-10_02:41:27.558699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:29.284352 run osmo-stp_10.42.42.5(pid=15021): stderr: | [0;m[38;5;43m20221210024127729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024127729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024127730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024127730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024127731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:29.430251 run patchelf(pid=15024): Terminating (SIGINT) 02:41:29.598639 run patchelf(pid=15024): Terminated: ok {rc=0} 02:41:29.719781 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15021): Process ended prematurely: osmo-stp_10.42.42.5(pid=15021) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15021)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:41:29.728826 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:41:29.756458 run osmo-hlr_10.42.42.2(pid=15018): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15018)] 02:41:29.804381 run osmo-hlr_10.42.42.2(pid=15018): stdout: | (launched: 2022-12-10_02:41:26.614920) 02:41:29.854044 run osmo-hlr_10.42.42.2(pid=15018): stderr: | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024126789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024126802 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024126810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024126810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024126810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:29.904159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15017): Terminating (SIGTERM) 02:41:29.944345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15020): Terminating (SIGTERM) 02:41:29.984458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15023): Terminating (SIGTERM) 02:41:30.025121 --- ParallelTerminationStrategy: PID 15017 died... 02:41:30.044032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15017): Terminated: ok {rc=0} 02:41:30.088785 --- ParallelTerminationStrategy: PID 15020 died... 02:41:30.107451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15020): Terminated: ok {rc=0} 02:41:30.151863 --- ParallelTerminationStrategy: PID 15023 died... 02:41:30.170469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15023): Terminated: ok {rc=0} 02:41:30.256589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:41:31.593809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:41:31.600272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:41:31.635410 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:41:31.676678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:41:31.769127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:41:31.805601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:41:31.846129 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:41:32.439880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:41:32.491472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:32.502740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:41:32.572441 tst cs_paging_gprs_active.py: using LAC 25422 02:41:32.691398 tst cs_paging_gprs_active.py: using RAC 177 02:41:32.810242 tst cs_paging_gprs_active.py: using CellId 25422 02:41:32.930201 tst cs_paging_gprs_active.py: using BVCI 25423 02:41:33.041124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.052049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.062836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.074139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.085407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.096573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.108028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.119326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:33.131017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:33.248040 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:33.367427 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:41:33.572541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:33.879837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15029): Launched 02:41:34.145269 run iperf3-srv_10.42.42.10(pid=15030): Launched 02:41:34.261558 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:41:34.465760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:34.771547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15031): Launched 02:41:35.036347 run iperf3-srv_10.42.42.10(pid=15032): Launched 02:41:35.151633 tst cs_paging_gprs_active.py:38: start network... 02:41:35.354845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:35.825634 run create_hlr_db(pid=15033): Launched 02:41:35.943074 bus /gobi_6: Setting Powered False 02:41:37.002862 run create_hlr_db(pid=15033): Terminated: ok {rc=0} 02:41:37.446653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Launched 02:41:37.755703 run osmo-hlr_10.42.42.2(pid=15036): Launched 02:41:37.872597 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:38.407395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Launched 02:41:38.711221 run osmo-stp_10.42.42.5(pid=15039): Launched 02:41:38.828423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:39.351447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15041): Launched 02:41:39.468156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:39.724493 run patchelf(pid=15042): Launched 02:41:39.894708 run osmo-stp_10.42.42.5(pid=15039): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] 02:41:40.023742 run osmo-stp_10.42.42.5(pid=15039): stdout: | (launched: 2022-12-10_02:41:38.655680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:40.154345 run osmo-stp_10.42.42.5(pid=15039): stderr: | [0;m[38;5;43m20221210024138825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024138825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024138826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024138826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:40.284599 run osmo-stp_10.42.42.5(pid=15039): stdout: | (launched: 2022-12-10_02:41:38.655680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:40.409688 run osmo-stp_10.42.42.5(pid=15039): stderr: | [0;m[38;5;43m20221210024138825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024138825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024138826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024138826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024138827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:40.558429 run patchelf(pid=15042): Terminating (SIGINT) 02:41:40.729083 run patchelf(pid=15042): Terminated: ok {rc=0} 02:41:40.852318 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15039): Process ended prematurely: osmo-stp_10.42.42.5(pid=15039) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:41:40.861972 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 02:41:40.889413 run osmo-hlr_10.42.42.2(pid=15036): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15036)] 02:41:40.938038 run osmo-hlr_10.42.42.2(pid=15036): stdout: | (launched: 2022-12-10_02:41:37.700028) 02:41:40.988033 run osmo-hlr_10.42.42.2(pid=15036): stderr: | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024137879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024137902 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024137911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024137911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024137911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:41.038611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15029): Terminating (SIGTERM) 02:41:41.079052 run iperf3-srv_10.42.42.10(pid=15030): Terminating (SIGTERM) 02:41:41.119264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15031): Terminating (SIGTERM) 02:41:41.160060 run iperf3-srv_10.42.42.10(pid=15032): Terminating (SIGTERM) 02:41:41.200161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Terminating (SIGTERM) 02:41:41.240308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Terminating (SIGTERM) 02:41:41.280622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15041): Terminating (SIGTERM) 02:41:41.321292 --- ParallelTerminationStrategy: PID 15029 died... 02:41:41.340517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15029): Terminated: ok {rc=0} 02:41:41.385639 --- ParallelTerminationStrategy: PID 15030 died... 02:41:41.404505 run iperf3-srv_10.42.42.10(pid=15030): Terminated {rc=256} 02:41:41.449370 --- ParallelTerminationStrategy: PID 15031 died... 02:41:41.468229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15031): Terminated: ok {rc=0} 02:41:41.513086 --- ParallelTerminationStrategy: PID 15032 died... 02:41:41.531877 run iperf3-srv_10.42.42.10(pid=15032): Terminated {rc=256} 02:41:41.576486 --- ParallelTerminationStrategy: PID 15035 died... 02:41:41.595262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Terminated: ok {rc=0} 02:41:41.640375 --- ParallelTerminationStrategy: PID 15038 died... 02:41:41.659340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Terminated: ok {rc=0} 02:41:41.704235 --- ParallelTerminationStrategy: PID 15041 died... 02:41:41.723108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15041): Terminated: ok {rc=0} 02:41:41.808572 bus /gobi_0: Setting Powered False 02:41:42.907948 bus /gobi_0: Setting Powered False 02:41:44.024172 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:41:45.174447 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.186495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:41:45.263270 tst iperf3.py: using LAC 25423 02:41:45.392707 tst iperf3.py: using RAC 178 02:41:45.521827 tst iperf3.py: using CellId 25423 02:41:45.652108 tst iperf3.py: using BVCI 25424 02:41:45.770411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.781846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.793179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.805096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.816860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.828709 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.858008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.870614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:45.882740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:46.013222 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:46.278618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:46.625469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Launched 02:41:46.913764 run iperf3-srv_10.42.42.10(pid=15044): Launched 02:41:47.039600 tst iperf3.py:8: start network... 02:41:47.258479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:47.765786 run create_hlr_db(pid=15045): Launched 02:41:47.899249 bus /gobi_6: Setting Powered False 02:41:48.962741 run create_hlr_db(pid=15045): Terminated: ok {rc=0} 02:41:49.394608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Launched 02:41:49.697994 run osmo-hlr_10.42.42.2(pid=15048): Launched 02:41:49.813874 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:50.341325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Launched 02:41:50.645466 run osmo-stp_10.42.42.5(pid=15051): Launched 02:41:50.762288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:51.286528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Launched 02:41:51.402843 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:51.659489 run patchelf(pid=15054): Launched 02:41:51.829466 run osmo-stp_10.42.42.5(pid=15051): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] 02:41:51.958744 run osmo-stp_10.42.42.5(pid=15051): stdout: | (launched: 2022-12-10_02:41:50.589719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:52.088879 run osmo-stp_10.42.42.5(pid=15051): stderr: | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024150759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:52.219156 run osmo-stp_10.42.42.5(pid=15051): stdout: | (launched: 2022-12-10_02:41:50.589719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:52.344103 run osmo-stp_10.42.42.5(pid=15051): stderr: | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024150758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024150759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024150761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:52.492014 run patchelf(pid=15054): Terminating (SIGINT) 02:41:52.663074 run patchelf(pid=15054): Terminated: ok {rc=0} 02:41:52.785844 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15051): Process ended prematurely: osmo-stp_10.42.42.5(pid=15051) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 02:41:52.795062 tst iperf3.py:8: Test FAILED (7.7 sec) 02:41:52.822727 run osmo-hlr_10.42.42.2(pid=15048): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15048)] 02:41:52.870593 run osmo-hlr_10.42.42.2(pid=15048): stdout: | (launched: 2022-12-10_02:41:49.642599) 02:41:52.919994 run osmo-hlr_10.42.42.2(pid=15048): stderr: | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024149821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024149834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024149843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024149844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024149844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:52.970510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Terminating (SIGTERM) 02:41:53.010524 run iperf3-srv_10.42.42.10(pid=15044): Terminating (SIGTERM) 02:41:53.050298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Terminating (SIGTERM) 02:41:53.090106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Terminating (SIGTERM) 02:41:53.129991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Terminating (SIGTERM) 02:41:53.170105 --- ParallelTerminationStrategy: PID 15043 died... 02:41:53.189075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Terminated: ok {rc=0} 02:41:53.234144 --- ParallelTerminationStrategy: PID 15044 died... 02:41:53.252473 run iperf3-srv_10.42.42.10(pid=15044): Terminated {rc=256} 02:41:53.296558 --- ParallelTerminationStrategy: PID 15047 died... 02:41:53.315007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Terminated: ok {rc=0} 02:41:53.359617 --- ParallelTerminationStrategy: PID 15050 died... 02:41:53.378104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Terminated: ok {rc=0} 02:41:53.422115 --- ParallelTerminationStrategy: PID 15053 died... 02:41:53.440417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Terminated: ok {rc=0} 02:41:53.524282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:41:54.673913 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:54.686157 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:41:54.761342 tst iperf3m4.py: using LAC 25424 02:41:54.890488 tst iperf3m4.py: using RAC 179 02:41:55.023621 tst iperf3m4.py: using CellId 25424 02:41:55.151803 tst iperf3m4.py: using BVCI 25425 02:41:55.269497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.281146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.292528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.303885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.315466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.326913 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.338796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.350251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:55.361939 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:55.482008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:55.601405 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:55.719793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:55.842500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:56.063107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:56.389792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15056): Launched 02:41:56.672284 run iperf3-srv_10.42.42.10(pid=15057): Launched 02:41:56.794848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:41:57.012651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:57.338217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15058): Launched 02:41:57.620637 run iperf3-srv_10.42.42.10(pid=15059): Launched 02:41:57.742873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:41:57.961229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:58.286528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15060): Launched 02:41:58.568695 run iperf3-srv_10.42.42.10(pid=15061): Launched 02:41:58.690997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:41:58.908596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:59.234767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15062): Launched 02:41:59.517466 run iperf3-srv_10.42.42.10(pid=15063): Launched 02:41:59.639598 tst iperf3m4.py:8: start network... 02:41:59.858117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:00.365255 run create_hlr_db(pid=15064): Launched 02:42:00.498479 bus /gobi_6: Setting Powered False 02:42:01.560828 run create_hlr_db(pid=15064): Terminated: ok {rc=0} 02:42:02.023078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15068): Launched 02:42:02.361787 run osmo-hlr_10.42.42.2(pid=15069): Launched 02:42:02.486187 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:03.049199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15071): Launched 02:42:03.373203 run osmo-stp_10.42.42.5(pid=15072): Launched 02:42:03.496612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:04.054716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15074): Launched 02:42:04.179722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:04.453623 run patchelf(pid=15075): Launched 02:42:04.635184 run osmo-stp_10.42.42.5(pid=15072): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15072)] 02:42:04.773196 run osmo-stp_10.42.42.5(pid=15072): stdout: | (launched: 2022-12-10_02:42:03.314440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:04.912049 run osmo-stp_10.42.42.5(pid=15072): stderr: | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024203507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:05.051855 run osmo-stp_10.42.42.5(pid=15072): stdout: | (launched: 2022-12-10_02:42:03.314440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:05.186100 run osmo-stp_10.42.42.5(pid=15072): stderr: | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024203507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024203507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024203508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:05.344006 run patchelf(pid=15075): Terminating (SIGINT) 02:42:05.526953 run patchelf(pid=15075): Terminated: ok {rc=0} 02:42:05.658260 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15072): Process ended prematurely: osmo-stp_10.42.42.5(pid=15072) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15072)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:42:05.668414 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:42:05.697354 run osmo-hlr_10.42.42.2(pid=15069): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15069)] 02:42:05.747158 run osmo-hlr_10.42.42.2(pid=15069): stdout: | (launched: 2022-12-10_02:42:02.302369) 02:42:05.798912 run osmo-hlr_10.42.42.2(pid=15069): stderr: | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024202500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024202513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024202522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024202522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024202522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:05.851020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15056): Terminating (SIGTERM) 02:42:05.892722 run iperf3-srv_10.42.42.10(pid=15057): Terminating (SIGTERM) 02:42:05.934510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15058): Terminating (SIGTERM) 02:42:05.976230 run iperf3-srv_10.42.42.10(pid=15059): Terminating (SIGTERM) 02:42:06.018502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15060): Terminating (SIGTERM) 02:42:06.060360 run iperf3-srv_10.42.42.10(pid=15061): Terminating (SIGTERM) 02:42:06.101929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15062): Terminating (SIGTERM) 02:42:06.143592 run iperf3-srv_10.42.42.10(pid=15063): Terminating (SIGTERM) 02:42:06.185149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15068): Terminating (SIGTERM) 02:42:06.226916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15071): Terminating (SIGTERM) 02:42:06.268790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15074): Terminating (SIGTERM) 02:42:06.310930 --- ParallelTerminationStrategy: PID 15056 died... 02:42:06.331072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15056): Terminated: ok {rc=0} 02:42:06.378020 --- ParallelTerminationStrategy: PID 15057 died... 02:42:06.397523 run iperf3-srv_10.42.42.10(pid=15057): Terminated {rc=256} 02:42:06.443235 --- ParallelTerminationStrategy: PID 15058 died... 02:42:06.463021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15058): Terminated: ok {rc=0} 02:42:06.509410 --- ParallelTerminationStrategy: PID 15059 died... 02:42:06.529152 run iperf3-srv_10.42.42.10(pid=15059): Terminated {rc=256} 02:42:06.575115 --- ParallelTerminationStrategy: PID 15060 died... 02:42:06.594768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15060): Terminated: ok {rc=0} 02:42:06.641064 --- ParallelTerminationStrategy: PID 15061 died... 02:42:06.660399 run iperf3-srv_10.42.42.10(pid=15061): Terminated {rc=256} 02:42:06.706454 --- ParallelTerminationStrategy: PID 15062 died... 02:42:06.726174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15062): Terminated: ok {rc=0} 02:42:06.772517 --- ParallelTerminationStrategy: PID 15063 died... 02:42:06.792265 run iperf3-srv_10.42.42.10(pid=15063): Terminated {rc=256} 02:42:06.838042 --- ParallelTerminationStrategy: PID 15068 died... 02:42:06.857894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15068): Terminated: ok {rc=0} 02:42:06.904132 --- ParallelTerminationStrategy: PID 15071 died... 02:42:06.923904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15071): Terminated: ok {rc=0} 02:42:06.970437 --- ParallelTerminationStrategy: PID 15074 died... 02:42:06.990277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15074): Terminated: ok {rc=0} 02:42:07.078413 bus /gobi_4: Setting Powered False 02:42:08.179116 bus /gobi_4: Setting Powered False 02:42:09.294989 bus /gobi_1: Setting Powered False 02:42:10.395049 bus /gobi_1: Setting Powered False 02:42:11.512249 bus /gobi_0: Setting Powered False 02:42:12.611927 bus /gobi_0: Setting Powered False 02:42:13.731814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:42:14.835326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:14.847091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:14.918513 tst ping.py: using LAC 25425 02:42:15.036316 tst ping.py: using RAC 180 02:42:15.160056 tst ping.py: using CellId 25425 02:42:15.285340 tst ping.py: using BVCI 25426 02:42:15.401506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.413228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.424627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.436668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.448507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.460552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.472468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.484118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:15.601934 tst ping.py:19: start network... 02:42:15.800641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:16.333277 run create_hlr_db(pid=15076): Launched 02:42:16.482679 bus /gobi_6: Setting Powered False 02:42:17.545634 run create_hlr_db(pid=15076): Terminated: ok {rc=0} 02:42:17.971090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Launched 02:42:18.270129 run osmo-hlr_10.42.42.2(pid=15079): Launched 02:42:18.383650 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:18.902896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Launched 02:42:19.201211 run osmo-stp_10.42.42.5(pid=15082): Launched 02:42:19.314281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:19.826882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15084): Launched 02:42:19.941448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:20.192865 run patchelf(pid=15085): Launched 02:42:20.359564 run osmo-stp_10.42.42.5(pid=15082): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] 02:42:20.485737 run osmo-stp_10.42.42.5(pid=15082): stdout: | (launched: 2022-12-10_02:42:19.146764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:20.613964 run osmo-stp_10.42.42.5(pid=15082): stderr: | [0;m[38;5;43m20221210024219315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024219315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024219316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024219316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024219316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024219316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024219317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:20.742140 run osmo-stp_10.42.42.5(pid=15082): stdout: | (launched: 2022-12-10_02:42:19.146764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:20.864277 run osmo-stp_10.42.42.5(pid=15082): stderr: | [0;m[38;5;43m20221210024219315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024219315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024219316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024219316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024219316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024219316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024219317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:21.008885 run patchelf(pid=15085): Terminating (SIGINT) 02:42:21.177285 run patchelf(pid=15085): Terminated: ok {rc=0} 02:42:21.298140 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15082): Process ended prematurely: osmo-stp_10.42.42.5(pid=15082) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 02:42:21.306873 tst ping.py:22: Test FAILED (6.5 sec) 02:42:21.334036 run osmo-hlr_10.42.42.2(pid=15079): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15079)] 02:42:21.382509 run osmo-hlr_10.42.42.2(pid=15079): stdout: | (launched: 2022-12-10_02:42:18.215762) 02:42:21.432426 run osmo-hlr_10.42.42.2(pid=15079): stderr: | [0;m[1;31m20221210024218394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024218394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024218394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024218394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024218394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024218395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024218408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024218417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024218418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024218418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:21.482248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Terminating (SIGTERM) 02:42:21.522292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Terminating (SIGTERM) 02:42:21.562486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15084): Terminating (SIGTERM) 02:42:21.602869 --- ParallelTerminationStrategy: PID 15078 died... 02:42:21.622071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15078): Terminated: ok {rc=0} 02:42:21.666799 --- ParallelTerminationStrategy: PID 15081 died... 02:42:21.685590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15081): Terminated: ok {rc=0} 02:42:21.729945 --- ParallelTerminationStrategy: PID 15084 died... 02:42:21.748700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15084): Terminated: ok {rc=0} 02:42:21.835285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:42:22.924369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:22.936543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:23.009429 tst ping_idle_ping.py: using LAC 25426 02:42:23.136575 tst ping_idle_ping.py: using RAC 181 02:42:23.261048 tst ping_idle_ping.py: using CellId 25426 02:42:23.380900 tst ping_idle_ping.py: using BVCI 25427 02:42:23.490174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.501428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.512593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.523935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.535496 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.546617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.557924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:23.569699 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:23.689432 tst ping_idle_ping.py:24: start network... 02:42:23.906357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:24.405585 run create_hlr_db(pid=15086): Launched 02:42:24.536216 bus /gobi_6: Setting Powered False 02:42:25.595383 run create_hlr_db(pid=15086): Terminated: ok {rc=0} 02:42:26.023526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Launched 02:42:26.322759 run osmo-hlr_10.42.42.2(pid=15089): Launched 02:42:26.437401 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:26.967910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Launched 02:42:27.267374 run osmo-stp_10.42.42.5(pid=15092): Launched 02:42:27.382105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:27.898677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Launched 02:42:28.014381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:28.267841 run patchelf(pid=15095): Launched 02:42:28.435716 run osmo-stp_10.42.42.5(pid=15092): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] 02:42:28.562454 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-10_02:42:27.212719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:28.691236 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024227384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:28.820223 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-10_02:42:27.212719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:28.943270 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024227384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024227384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024227385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:29.089195 run patchelf(pid=15095): Terminating (SIGINT) 02:42:29.258299 run patchelf(pid=15095): Terminated: ok {rc=0} 02:42:29.380004 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:42:29.388911 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:42:29.416203 run osmo-hlr_10.42.42.2(pid=15089): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15089)] 02:42:29.464628 run osmo-hlr_10.42.42.2(pid=15089): stdout: | (launched: 2022-12-10_02:42:26.268035) 02:42:29.514786 run osmo-hlr_10.42.42.2(pid=15089): stderr: | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024226442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024226454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024226464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024226465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024226465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:29.565336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminating (SIGTERM) 02:42:29.606009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminating (SIGTERM) 02:42:29.646349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Terminating (SIGTERM) 02:42:29.686762 --- ParallelTerminationStrategy: PID 15088 died... 02:42:29.705990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminated: ok {rc=0} 02:42:29.750711 --- ParallelTerminationStrategy: PID 15091 died... 02:42:29.769640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminated: ok {rc=0} 02:42:29.814466 --- ParallelTerminationStrategy: PID 15094 died... 02:42:29.833317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Terminated: ok {rc=0} 02:42:29.919862 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:42:31.270071 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:31.277643 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:42:31.315113 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:42:31.351943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:42:31.410481 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:42:31.454756 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:42:31.491948 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:42:32.038980 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:42:32.044799 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.057723 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:42:32.137006 tst switch_tch_pdch.py: using LAC 25427 02:42:32.292068 tst switch_tch_pdch.py: using RAC 182 02:42:32.409793 tst switch_tch_pdch.py: using CellId 25427 02:42:32.526479 tst switch_tch_pdch.py: using BVCI 25428 02:42:32.636674 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.648097 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.659366 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.670764 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.682090 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.693353 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.704683 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:32.715939 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:42:32.833928 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:42:32.950367 tst switch_tch_pdch.py:51: start network... 02:42:33.166169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:33.657757 run create_hlr_db(pid=15099): Launched 02:42:33.788662 bus /gobi_6: Setting Powered False 02:42:34.852057 run create_hlr_db(pid=15099): Terminated: ok {rc=0} 02:42:35.295240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15101): Launched 02:42:35.613539 run osmo-hlr_10.42.42.2(pid=15102): Launched 02:42:35.735321 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:36.288906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15104): Launched 02:42:36.606098 run osmo-stp_10.42.42.5(pid=15105): Launched 02:42:36.730034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:37.278435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15107): Launched 02:42:37.400471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:37.668815 run patchelf(pid=15108): Launched 02:42:37.846202 run osmo-stp_10.42.42.5(pid=15105): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15105)] 02:42:37.980663 run osmo-stp_10.42.42.5(pid=15105): stdout: | (launched: 2022-12-10_02:42:36.548406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:38.117338 run osmo-stp_10.42.42.5(pid=15105): stderr: | [0;m[38;5;43m20221210024236739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024236739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024236740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024236740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:38.254135 run osmo-stp_10.42.42.5(pid=15105): stdout: | (launched: 2022-12-10_02:42:36.548406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:38.384602 run osmo-stp_10.42.42.5(pid=15105): stderr: | [0;m[38;5;43m20221210024236739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024236739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024236740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024236740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024236741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:38.538883 run patchelf(pid=15108): Terminating (SIGINT) 02:42:38.717099 run patchelf(pid=15108): Terminated: ok {rc=0} 02:42:38.845038 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15105): Process ended prematurely: osmo-stp_10.42.42.5(pid=15105) [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15105)] [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:42:38.854607 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:42:38.882342 run osmo-hlr_10.42.42.2(pid=15102): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15102)] 02:42:38.931957 run osmo-hlr_10.42.42.2(pid=15102): stdout: | (launched: 2022-12-10_02:42:35.555863) 02:42:38.983395 run osmo-hlr_10.42.42.2(pid=15102): stderr: | [0;m[1;31m20221210024235755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024235755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024235755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024235756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024235756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024235756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024235768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024235776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024235777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024235777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:39.035274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15101): Terminating (SIGTERM) 02:42:39.077297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15104): Terminating (SIGTERM) 02:42:39.119079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15107): Terminating (SIGTERM) 02:42:39.160738 --- ParallelTerminationStrategy: PID 15101 died... 02:42:39.180312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15101): Terminated: ok {rc=0} 02:42:39.226478 --- ParallelTerminationStrategy: PID 15104 died... 02:42:39.246112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15104): Terminated: ok {rc=0} 02:42:39.292154 --- ParallelTerminationStrategy: PID 15107 died... 02:42:39.311813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15107): Terminated: ok {rc=0} 02:42:39.399714 bus /gobi_0: Setting Powered False 02:42:40.499066 bus /gobi_0: Setting Powered False 02:42:41.614861 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:42:42.872824 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:42.879195 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:42:42.913878 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:42:42.949127 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:42:43.004919 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:42:43.040187 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:42:43.075769 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:42:43.632430 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:42:43.637610 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:43.648927 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:42:43.720355 tst switch_tch_pdch.py: using LAC 25428 02:42:43.846741 tst switch_tch_pdch.py: using RAC 183 02:42:43.964530 tst switch_tch_pdch.py: using CellId 25428 02:42:44.080750 tst switch_tch_pdch.py: using BVCI 25429 02:42:44.189036 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.200184 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.211252 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.222555 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.233704 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.244653 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.255835 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:44.267025 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:42:44.387685 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:42:44.502677 tst switch_tch_pdch.py:51: start network... 02:42:44.703078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:45.139432 run create_hlr_db(pid=15112): Launched 02:42:45.253127 bus /gobi_6: Setting Powered False 02:42:46.312373 run create_hlr_db(pid=15112): Terminated: ok {rc=0} 02:42:46.722030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Launched 02:42:47.039186 run osmo-hlr_10.42.42.2(pid=15115): Launched 02:42:47.244097 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:47.767628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Launched 02:42:48.086682 run osmo-stp_10.42.42.5(pid=15118): Launched 02:42:48.208206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:48.730664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Launched 02:42:48.853133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:49.122844 run patchelf(pid=15121): Launched 02:42:49.301734 run osmo-stp_10.42.42.5(pid=15118): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] 02:42:49.437317 run osmo-stp_10.42.42.5(pid=15118): stdout: | (launched: 2022-12-10_02:42:48.028446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:49.574484 run osmo-stp_10.42.42.5(pid=15118): stderr: | [0;m[38;5;43m20221210024248221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024248222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024248222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024248222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:49.711432 run osmo-stp_10.42.42.5(pid=15118): stdout: | (launched: 2022-12-10_02:42:48.028446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:49.842105 run osmo-stp_10.42.42.5(pid=15118): stderr: | [0;m[38;5;43m20221210024248221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024248222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024248222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024248222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024248223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:49.997338 run patchelf(pid=15121): Terminating (SIGINT) 02:42:50.177686 run patchelf(pid=15121): Terminated: ok {rc=0} 02:42:50.306647 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15118): Process ended prematurely: osmo-stp_10.42.42.5(pid=15118) [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:42:50.316237 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:42:50.344461 run osmo-hlr_10.42.42.2(pid=15115): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15115)] 02:42:50.394847 run osmo-hlr_10.42.42.2(pid=15115): stdout: | (launched: 2022-12-10_02:42:46.970425) 02:42:50.446782 run osmo-hlr_10.42.42.2(pid=15115): stderr: | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024247259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024247271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024247281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024247281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024247281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:50.499506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Terminating (SIGTERM) 02:42:50.541601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Terminating (SIGTERM) 02:42:50.583675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Terminating (SIGTERM) 02:42:50.625956 --- ParallelTerminationStrategy: PID 15114 died... 02:42:50.645988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15114): Terminated: ok {rc=0} 02:42:50.692431 --- ParallelTerminationStrategy: PID 15117 died... 02:42:50.712217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15117): Terminated: ok {rc=0} 02:42:50.758296 --- ParallelTerminationStrategy: PID 15120 died... 02:42:50.778167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15120): Terminated: ok {rc=0} 02:42:50.866613 bus /gobi_0: Setting Powered False 02:42:51.964809 bus /gobi_0: Setting Powered False 02:42:53.081487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:trx-umtrx --------------------------------------------------------------------- 02:42:54.332924 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:54.336648 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:42:54.369512 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:42:54.376194 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:42:54.427881 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:42:54.460244 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:42:54.466934 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:42:55.007864 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:42:55.013612 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:42:55.025696 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:42:55.072821 tst mo_mt_sms.py: using LAC 25429 02:42:55.196883 tst mo_mt_sms.py: using RAC 184 02:42:55.319488 tst mo_mt_sms.py: using CellId 25429 02:42:55.441623 tst mo_mt_sms.py: using BVCI 25430 02:42:55.556510 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:42:55.671928 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:42:55.785188 tst mo_mt_sms.py:9: start nitb and bts... 02:42:55.985966 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:42:56.593252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15126): Launched 02:42:56.890839 run osmo-nitb_10.42.42.2(pid=15127): Launched 02:42:57.056421 run osmo-nitb_10.42.42.2(pid=15127): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15127)] 02:42:57.191438 run osmo-nitb_10.42.42.2(pid=15127): stdout: | (launched: 2022-12-10_02:42:56.836486) 02:42:57.326953 run osmo-nitb_10.42.42.2(pid=15127): stderr: | (launched: 2022-12-10_02:42:56.880573) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:42:57.462299 run osmo-nitb_10.42.42.2(pid=15127): stdout: | (launched: 2022-12-10_02:42:56.836486) 02:42:57.592429 run osmo-nitb_10.42.42.2(pid=15127): stderr: | (launched: 2022-12-10_02:42:56.880573) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15127) [trial-2368↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15127)] 02:42:58.004081 tst osmo-nitb_10.42.42.2(pid=15127): stdout: | (launched: 2022-12-10_02:42:56.836486) 02:42:58.124183 tst osmo-nitb_10.42.42.2(pid=15127): stderr: | (launched: 2022-12-10_02:42:56.880573) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:42:58.265940 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15127) [trial-2368↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15127)] [trial-2368↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 02:42:58.274164 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:42:58.280656 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15126): Terminating (SIGTERM) 02:42:58.490107 --- ParallelTerminationStrategy: PID 15126 died... 02:42:58.511147 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15126): Terminated: ok {rc=0} 02:42:58.597254 bus /sierra_3: Setting Powered False 02:42:59.696544 bus /sierra_3: Setting Powered False 02:43:00.813738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:trx-umtrx --------------------------------------------------------------------- 02:43:02.100878 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:02.110108 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:02.146024 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:43:02.173666 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:43:02.226590 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:02.260829 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:43:02.288321 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:43:02.834472 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:43:02.840375 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:02.851420 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:02.899308 tst mo_mt_sms.py: using LAC 25430 02:43:03.017172 tst mo_mt_sms.py: using RAC 185 02:43:03.143269 tst mo_mt_sms.py: using CellId 25430 02:43:03.269421 tst mo_mt_sms.py: using BVCI 25431 02:43:03.386028 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:03.397221 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:03.408129 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:03.419174 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:03.430027 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:03.440641 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:03.558090 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:03.672907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:04.133672 run create_hlr_db(pid=15131): Launched 02:43:04.248444 bus /sierra_2: Setting Powered False 02:43:05.308240 run create_hlr_db(pid=15131): Terminated: ok {rc=0} 02:43:05.742572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15133): Launched 02:43:06.061179 run osmo-hlr_10.42.42.2(pid=15134): Launched 02:43:06.182910 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:06.735205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15136): Launched 02:43:07.053768 run osmo-stp_10.42.42.5(pid=15137): Launched 02:43:07.175349 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:07.751723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15139): Launched 02:43:08.070218 run osmo-msc_10.42.42.6(pid=15140): Launched 02:43:08.248744 run osmo-stp_10.42.42.5(pid=15137): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15137)] 02:43:08.383284 run osmo-stp_10.42.42.5(pid=15137): stdout: | (launched: 2022-12-10_02:43:06.995780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:08.519357 run osmo-stp_10.42.42.5(pid=15137): stderr: | [0;m[38;5;43m20221210024307188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024307189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024307189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024307189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:08.653601 run osmo-stp_10.42.42.5(pid=15137): stdout: | (launched: 2022-12-10_02:43:06.995780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:08.780043 run osmo-stp_10.42.42.5(pid=15137): stderr: | [0;m[38;5;43m20221210024307188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024307189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024307189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024307189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024307190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:08.931516 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15137): Process ended prematurely: osmo-stp_10.42.42.5(pid=15137) [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15137)] [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py:16] 02:43:08.940251 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 02:43:08.967400 run osmo-hlr_10.42.42.2(pid=15134): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15134)] 02:43:09.017346 run osmo-hlr_10.42.42.2(pid=15134): stdout: | (launched: 2022-12-10_02:43:06.003237) 02:43:09.069172 run osmo-hlr_10.42.42.2(pid=15134): stderr: | [0;m[1;31m20221210024306201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024306202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024306202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024306202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024306202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024306202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024306214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024306222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024306222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024306222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:09.141706 run osmo-msc_10.42.42.6(pid=15140): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15140)] 02:43:09.191767 run osmo-msc_10.42.42.6(pid=15140): stdout: | (launched: 2022-12-10_02:43:08.012522) 02:43:09.243388 run osmo-msc_10.42.42.6(pid=15140): stderr: | [0;m[38;5;43m20221210024308331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024308332 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d9f79bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024308332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024308332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024308332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024308332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024308334 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024308334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024308334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024308334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:09.295248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15133): Terminating (SIGTERM) 02:43:09.336931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15136): Terminating (SIGTERM) 02:43:09.378895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15139): Terminating (SIGTERM) 02:43:09.421124 --- ParallelTerminationStrategy: PID 15133 died... 02:43:09.440585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15133): Terminated: ok {rc=0} 02:43:09.486566 --- ParallelTerminationStrategy: PID 15136 died... 02:43:09.505972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15136): Terminated: ok {rc=0} 02:43:09.551808 --- ParallelTerminationStrategy: PID 15139 died... 02:43:09.571292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15139): Terminated: ok {rc=0} 02:43:09.658209 bus /sierra_3: Setting Powered False 02:43:10.757826 bus /sierra_3: Setting Powered False 02:43:11.874899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 02:43:13.102644 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:13.107078 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:13.140326 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:43:13.147294 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:43:13.182816 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:13.216394 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:43:13.223841 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:43:13.742989 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:43:13.748332 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:43:13.759576 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:13.811617 tst assert_extension.py: using LAC 25431 02:43:13.927942 tst assert_extension.py: using RAC 186 02:43:14.052490 tst assert_extension.py: using CellId 25431 02:43:14.176728 tst assert_extension.py: using BVCI 25432 02:43:14.293310 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:43:14.407825 tst assert_extension.py:10: start nitb and bts... 02:43:14.608818 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:43:15.215488 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15145): Launched 02:43:15.512451 run osmo-nitb_10.42.42.2(pid=15146): Launched 02:43:15.677668 run osmo-nitb_10.42.42.2(pid=15146): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15146)] 02:43:15.811942 run osmo-nitb_10.42.42.2(pid=15146): stdout: | (launched: 2022-12-10_02:43:15.458262) 02:43:15.957600 run osmo-nitb_10.42.42.2(pid=15146): stderr: | (launched: 2022-12-10_02:43:15.502342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:16.096334 run osmo-nitb_10.42.42.2(pid=15146): stdout: | (launched: 2022-12-10_02:43:15.458262) 02:43:16.229583 run osmo-nitb_10.42.42.2(pid=15146): stderr: | (launched: 2022-12-10_02:43:15.502342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15146) [trial-2368↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15146)] 02:43:16.624468 tst osmo-nitb_10.42.42.2(pid=15146): stdout: | (launched: 2022-12-10_02:43:15.458262) 02:43:16.755486 tst osmo-nitb_10.42.42.2(pid=15146): stderr: | (launched: 2022-12-10_02:43:15.502342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:16.901508 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15146) [trial-2368↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15146)] [trial-2368↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 02:43:16.910836 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:43:16.918456 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15145): Terminating (SIGTERM) 02:43:17.131237 --- ParallelTerminationStrategy: PID 15145 died... 02:43:17.152754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15145): Terminated: ok {rc=0} 02:43:17.242325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:trx-umtrx --------------------------------------------------------------------- 02:43:18.416055 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:18.419868 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:18.452896 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:43:18.479195 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:43:18.514690 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:18.547019 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:43:18.573672 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:43:19.100941 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:43:19.105861 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.116327 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:19.162339 tst assert_extension.py: using LAC 25432 02:43:19.280564 tst assert_extension.py: using RAC 187 02:43:19.396751 tst assert_extension.py: using CellId 25432 02:43:19.516684 tst assert_extension.py: using BVCI 25433 02:43:19.626102 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.636563 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.646994 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.657585 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.668136 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:19.678688 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:43:19.798401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:20.259200 run create_hlr_db(pid=15152): Launched 02:43:20.372267 bus /sierra_2: Setting Powered False 02:43:21.431860 run create_hlr_db(pid=15152): Terminated: ok {rc=0} 02:43:21.867500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Launched 02:43:22.186647 run osmo-hlr_10.42.42.2(pid=15155): Launched 02:43:22.308574 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:22.861290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Launched 02:43:23.179053 run osmo-stp_10.42.42.5(pid=15158): Launched 02:43:23.299786 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:23.873060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15160): Launched 02:43:24.191112 run osmo-msc_10.42.42.6(pid=15161): Launched 02:43:24.368341 run osmo-stp_10.42.42.5(pid=15158): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] 02:43:24.502217 run osmo-stp_10.42.42.5(pid=15158): stdout: | (launched: 2022-12-10_02:43:23.121094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:24.637277 run osmo-stp_10.42.42.5(pid=15158): stderr: | [0;m[38;5;43m20221210024323310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024323311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024323311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024323311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:24.771106 run osmo-stp_10.42.42.5(pid=15158): stdout: | (launched: 2022-12-10_02:43:23.121094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:24.897313 run osmo-stp_10.42.42.5(pid=15158): stderr: | [0;m[38;5;43m20221210024323310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024323311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024323311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024323311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024323314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:25.048711 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15158): Process ended prematurely: osmo-stp_10.42.42.5(pid=15158) [trial-2368↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] [trial-2368↪ussd:trx-umtrx↪assert_extension.py:17] 02:43:25.057450 tst assert_extension.py:17: Test FAILED (5.9 sec) 02:43:25.084737 run osmo-hlr_10.42.42.2(pid=15155): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15155)] 02:43:25.134839 run osmo-hlr_10.42.42.2(pid=15155): stdout: | (launched: 2022-12-10_02:43:22.128513) 02:43:25.186248 run osmo-hlr_10.42.42.2(pid=15155): stderr: | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024322326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024322339 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024322347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024322348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024322348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:25.257867 run osmo-msc_10.42.42.6(pid=15161): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15161)] 02:43:25.307567 run osmo-msc_10.42.42.6(pid=15161): stdout: | (launched: 2022-12-10_02:43:24.133460) 02:43:25.359114 run osmo-msc_10.42.42.6(pid=15161): stderr: | [0;m[38;5;43m20221210024324452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024324453 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca9cd3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024324453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024324453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024324453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024324453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024324455 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024324455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024324455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024324456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:25.411006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Terminating (SIGTERM) 02:43:25.452395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Terminating (SIGTERM) 02:43:25.494006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15160): Terminating (SIGTERM) 02:43:25.535807 --- ParallelTerminationStrategy: PID 15154 died... 02:43:25.555354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15154): Terminated: ok {rc=0} 02:43:25.601127 --- ParallelTerminationStrategy: PID 15157 died... 02:43:25.620456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15157): Terminated: ok {rc=0} 02:43:25.665991 --- ParallelTerminationStrategy: PID 15160 died... 02:43:25.685365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15160): Terminated: ok {rc=0} 02:43:25.772292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:43:26.985089 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:26.992346 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:43:27.026054 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:43:27.053745 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:43:27.107866 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:43:27.141542 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:43:27.168717 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:43:27.719456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:43:27.771767 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:27.783210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:43:27.852781 tst mo_mt_call.py: using LAC 25433 02:43:27.972758 tst mo_mt_call.py: using RAC 188 02:43:28.092638 tst mo_mt_call.py: using CellId 25433 02:43:28.212649 tst mo_mt_call.py: using BVCI 25434 02:43:28.323564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:28.334810 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:28.345922 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:28.357907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:28.369780 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:28.381529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:28.497279 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:28.617681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:29.123577 run create_hlr_db(pid=15166): Launched 02:43:29.257051 bus /sierra_2: Setting Powered False 02:43:30.321528 run create_hlr_db(pid=15166): Terminated: ok {rc=0} 02:43:30.772423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Launched 02:43:31.126815 run osmo-hlr_10.42.42.2(pid=15169): Launched 02:43:31.384770 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:32.025771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Launched 02:43:32.363694 run osmo-stp_10.42.42.5(pid=15172): Launched 02:43:32.487925 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:33.075431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Launched 02:43:33.400373 run osmo-msc_10.42.42.6(pid=15175): Launched 02:43:33.582291 run osmo-stp_10.42.42.5(pid=15172): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] 02:43:33.719389 run osmo-stp_10.42.42.5(pid=15172): stdout: | (launched: 2022-12-10_02:43:32.304352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:33.857091 run osmo-stp_10.42.42.5(pid=15172): stderr: | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024332496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:33.993429 run osmo-stp_10.42.42.5(pid=15172): stdout: | (launched: 2022-12-10_02:43:32.304352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:34.122689 run osmo-stp_10.42.42.5(pid=15172): stderr: | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024332495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024332496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024332496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:34.277198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15172): Process ended prematurely: osmo-stp_10.42.42.5(pid=15172) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:43:34.286691 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 02:43:34.314343 run osmo-hlr_10.42.42.2(pid=15169): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15169)] 02:43:34.364478 run osmo-hlr_10.42.42.2(pid=15169): stdout: | (launched: 2022-12-10_02:43:31.064877) 02:43:34.416394 run osmo-hlr_10.42.42.2(pid=15169): stderr: | [0;m[1;31m20221210024331341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024331341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024331341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024331342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024331342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024331342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024331363 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:34.488684 run osmo-msc_10.42.42.6(pid=15175): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15175)] 02:43:34.538982 run osmo-msc_10.42.42.6(pid=15175): stdout: | (launched: 2022-12-10_02:43:33.341417) 02:43:34.590753 run osmo-msc_10.42.42.6(pid=15175): stderr: | [0;m[38;5;43m20221210024333666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024333666 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c1279cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024333666 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024333666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024333666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024333666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024333668 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024333669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024333669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024333669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:34.643454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Terminating (SIGTERM) 02:43:34.685604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Terminating (SIGTERM) 02:43:34.728182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Terminating (SIGTERM) 02:43:34.770449 --- ParallelTerminationStrategy: PID 15168 died... 02:43:34.790313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15168): Terminated: ok {rc=0} 02:43:34.836278 --- ParallelTerminationStrategy: PID 15171 died... 02:43:34.855800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15171): Terminated: ok {rc=0} 02:43:34.902492 --- ParallelTerminationStrategy: PID 15174 died... 02:43:34.922060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15174): Terminated: ok {rc=0} 02:43:35.010270 bus /sierra_3: Setting Powered False 02:43:36.111815 bus /sierra_3: Setting Powered False 02:43:37.227470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:43:38.378350 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.390477 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:43:38.461556 tst mo_mt_call_osmux.py: using LAC 25434 02:43:38.583877 tst mo_mt_call_osmux.py: using RAC 189 02:43:38.703564 tst mo_mt_call_osmux.py: using CellId 25434 02:43:38.822808 tst mo_mt_call_osmux.py: using BVCI 25435 02:43:38.935072 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.946158 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.957273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.968341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.979453 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:38.990522 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:39.110154 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:39.230730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:39.735318 run create_hlr_db(pid=15177): Launched 02:43:39.867943 bus /sierra_2: Setting Powered False 02:43:40.932155 run create_hlr_db(pid=15177): Terminated: ok {rc=0} 02:43:41.365082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15179): Launched 02:43:41.669999 run osmo-hlr_10.42.42.2(pid=15180): Launched 02:43:41.785906 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:42.329163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15182): Launched 02:43:42.632900 run osmo-stp_10.42.42.5(pid=15183): Launched 02:43:42.749874 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:43.300154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15185): Launched 02:43:43.604192 run osmo-msc_10.42.42.6(pid=15186): Launched 02:43:43.775800 run osmo-stp_10.42.42.5(pid=15183): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15183)] 02:43:43.905898 run osmo-stp_10.42.42.5(pid=15183): stdout: | (launched: 2022-12-10_02:43:42.577141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:44.035798 run osmo-stp_10.42.42.5(pid=15183): stderr: | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024342749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:44.163277 run osmo-stp_10.42.42.5(pid=15183): stdout: | (launched: 2022-12-10_02:43:42.577141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:44.283494 run osmo-stp_10.42.42.5(pid=15183): stderr: | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024342748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024342749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024342751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:44.427837 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15183): Process ended prematurely: osmo-stp_10.42.42.5(pid=15183) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15183)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:43:44.436707 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:43:44.463651 run osmo-hlr_10.42.42.2(pid=15180): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15180)] 02:43:44.511996 run osmo-hlr_10.42.42.2(pid=15180): stdout: | (launched: 2022-12-10_02:43:41.614382) 02:43:44.561608 run osmo-hlr_10.42.42.2(pid=15180): stderr: | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024341790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024341802 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024341811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024341811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024341811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:44.630956 run osmo-msc_10.42.42.6(pid=15186): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15186)] 02:43:44.678935 run osmo-msc_10.42.42.6(pid=15186): stdout: | (launched: 2022-12-10_02:43:43.548355) 02:43:44.728464 run osmo-msc_10.42.42.6(pid=15186): stderr: | [0;m[38;5;43m20221210024343820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024343821 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f725f673c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024343821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024343821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024343821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024343821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024343824 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024343825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024343825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024343826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:44.778457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15179): Terminating (SIGTERM) 02:43:44.818438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15182): Terminating (SIGTERM) 02:43:44.858266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15185): Terminating (SIGTERM) 02:43:44.898373 --- ParallelTerminationStrategy: PID 15179 died... 02:43:44.917528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15179): Terminated: ok {rc=0} 02:43:44.961909 --- ParallelTerminationStrategy: PID 15182 died... 02:43:44.980530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15182): Terminated: ok {rc=0} 02:43:45.024611 --- ParallelTerminationStrategy: PID 15185 died... 02:43:45.043186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15185): Terminated: ok {rc=0} 02:43:45.127379 bus /sierra_3: Setting Powered False 02:43:46.226276 bus /sierra_3: Setting Powered False 02:43:47.353229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:43:48.603022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:48.609885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:43:48.642806 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:43:48.670161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:43:48.723761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:43:48.757031 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:43:48.784544 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:43:49.335968 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:43:49.387702 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:49.399325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:43:49.472686 tst mo_mt_call.py: using LAC 25435 02:43:49.598803 tst mo_mt_call.py: using RAC 190 02:43:49.725632 tst mo_mt_call.py: using CellId 25435 02:43:49.851047 tst mo_mt_call.py: using BVCI 25436 02:43:49.968583 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:49.980132 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:49.991511 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:50.002875 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:50.014330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:50.025776 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:43:50.147902 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:43:50.267575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:50.770451 run create_hlr_db(pid=15192): Launched 02:43:50.902828 bus /sierra_2: Setting Powered False 02:43:51.966672 run create_hlr_db(pid=15192): Terminated: ok {rc=0} 02:43:52.400650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15194): Launched 02:43:52.705194 run osmo-hlr_10.42.42.2(pid=15195): Launched 02:43:52.821856 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:53.344028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15197): Launched 02:43:53.647641 run osmo-stp_10.42.42.5(pid=15198): Launched 02:43:53.763856 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:54.313267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15200): Launched 02:43:54.616749 run osmo-msc_10.42.42.6(pid=15201): Launched 02:43:54.787462 run osmo-stp_10.42.42.5(pid=15198): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15198)] 02:43:54.917210 run osmo-stp_10.42.42.5(pid=15198): stdout: | (launched: 2022-12-10_02:43:53.592097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:55.046243 run osmo-stp_10.42.42.5(pid=15198): stderr: | [0;m[38;5;43m20221210024353764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024353764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024353765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024353765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:55.172789 run osmo-stp_10.42.42.5(pid=15198): stdout: | (launched: 2022-12-10_02:43:53.592097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:55.292903 run osmo-stp_10.42.42.5(pid=15198): stderr: | [0;m[38;5;43m20221210024353764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024353764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024353765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024353765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024353766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:55.436755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15198): Process ended prematurely: osmo-stp_10.42.42.5(pid=15198) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15198)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:43:55.445515 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:43:55.472332 run osmo-hlr_10.42.42.2(pid=15195): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15195)] 02:43:55.519784 run osmo-hlr_10.42.42.2(pid=15195): stdout: | (launched: 2022-12-10_02:43:52.649605) 02:43:55.569103 run osmo-hlr_10.42.42.2(pid=15195): stderr: | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024352828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024352840 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024352849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024352849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024352849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:55.638334 run osmo-msc_10.42.42.6(pid=15201): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15201)] 02:43:55.686003 run osmo-msc_10.42.42.6(pid=15201): stdout: | (launched: 2022-12-10_02:43:54.560930) 02:43:55.735642 run osmo-msc_10.42.42.6(pid=15201): stderr: | [0;m[38;5;43m20221210024354834 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024354835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ea2da1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024354835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024354835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024354835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024354835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024354837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024354837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024354837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024354838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:55.785428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15194): Terminating (SIGTERM) 02:43:55.825240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15197): Terminating (SIGTERM) 02:43:55.865065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15200): Terminating (SIGTERM) 02:43:55.905172 --- ParallelTerminationStrategy: PID 15194 died... 02:43:55.924102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15194): Terminated: ok {rc=0} 02:43:55.968415 --- ParallelTerminationStrategy: PID 15197 died... 02:43:55.987039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15197): Terminated: ok {rc=0} 02:43:56.031731 --- ParallelTerminationStrategy: PID 15200 died... 02:43:56.050391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15200): Terminated: ok {rc=0} 02:43:56.134238 bus /sierra_3: Setting Powered False 02:43:57.230549 bus /sierra_3: Setting Powered False 02:43:58.345989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:43:59.491955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:43:59.503676 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:43:59.576546 tst mo_mt_call_osmux.py: using LAC 25436 02:43:59.704309 tst mo_mt_call_osmux.py: using RAC 191 02:43:59.831470 tst mo_mt_call_osmux.py: using CellId 25436 02:43:59.960608 tst mo_mt_call_osmux.py: using BVCI 25437 02:44:00.078479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.090355 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.102302 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.113941 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.125949 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.137759 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:00.253783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:00.379876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:00.860657 run create_hlr_db(pid=15203): Launched 02:44:01.043513 bus /sierra_2: Setting Powered False 02:44:02.125632 run create_hlr_db(pid=15203): Terminated: ok {rc=0} 02:44:02.598215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15205): Launched 02:44:02.924274 run osmo-hlr_10.42.42.2(pid=15206): Launched 02:44:03.049836 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:03.610802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15208): Launched 02:44:03.936705 run osmo-stp_10.42.42.5(pid=15209): Launched 02:44:04.060422 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:04.647439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15211): Launched 02:44:04.972504 run osmo-msc_10.42.42.6(pid=15212): Launched 02:44:05.153636 run osmo-stp_10.42.42.5(pid=15209): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15209)] 02:44:05.290402 run osmo-stp_10.42.42.5(pid=15209): stdout: | (launched: 2022-12-10_02:44:03.877503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:05.428086 run osmo-stp_10.42.42.5(pid=15209): stderr: | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024404069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:05.564749 run osmo-stp_10.42.42.5(pid=15209): stdout: | (launched: 2022-12-10_02:44:03.877503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:05.693588 run osmo-stp_10.42.42.5(pid=15209): stderr: | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024404068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024404069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024404071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:05.847591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15209): Process ended prematurely: osmo-stp_10.42.42.5(pid=15209) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15209)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:44:05.856809 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:44:05.884291 run osmo-hlr_10.42.42.2(pid=15206): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15206)] 02:44:05.933922 run osmo-hlr_10.42.42.2(pid=15206): stdout: | (launched: 2022-12-10_02:44:02.864815) 02:44:05.985213 run osmo-hlr_10.42.42.2(pid=15206): stderr: | [0;m[1;31m20221210024403064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024403065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024403065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024403065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024403065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024403065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024403077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024403086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024403086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024403086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:06.056823 run osmo-msc_10.42.42.6(pid=15212): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15212)] 02:44:06.106926 run osmo-msc_10.42.42.6(pid=15212): stdout: | (launched: 2022-12-10_02:44:04.913273) 02:44:06.158353 run osmo-msc_10.42.42.6(pid=15212): stderr: | [0;m[38;5;43m20221210024405235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024405235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb12099ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024405235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024405235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024405235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024405236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024405237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024405238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024405238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024405238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:06.209953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15205): Terminating (SIGTERM) 02:44:06.251139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15208): Terminating (SIGTERM) 02:44:06.292541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15211): Terminating (SIGTERM) 02:44:06.334441 --- ParallelTerminationStrategy: PID 15205 died... 02:44:06.354206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15205): Terminated: ok {rc=0} 02:44:06.399971 --- ParallelTerminationStrategy: PID 15208 died... 02:44:06.419376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15208): Terminated: ok {rc=0} 02:44:06.465418 --- ParallelTerminationStrategy: PID 15211 died... 02:44:06.484788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15211): Terminated: ok {rc=0} 02:44:06.571896 bus /sierra_3: Setting Powered False 02:44:07.671434 bus /sierra_3: Setting Powered False 02:44:08.789937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:44:10.048334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:10.055121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:44:10.088142 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:44:10.115727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:44:10.167030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:44:10.200244 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:44:10.227693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:44:10.781837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:44:10.833626 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:10.845115 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:44:10.913834 tst mo_mt_call.py: using LAC 25437 02:44:11.041887 tst mo_mt_call.py: using RAC 192 02:44:11.168774 tst mo_mt_call.py: using CellId 25437 02:44:11.294692 tst mo_mt_call.py: using BVCI 25438 02:44:11.412268 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:11.423758 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:11.435022 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:11.446399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:11.457833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:11.469056 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:11.592124 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:11.707837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:12.178894 run create_hlr_db(pid=15217): Launched 02:44:12.295781 bus /sierra_2: Setting Powered False 02:44:13.355891 run create_hlr_db(pid=15217): Terminated: ok {rc=0} 02:44:13.800069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Launched 02:44:14.126232 run osmo-hlr_10.42.42.2(pid=15220): Launched 02:44:14.251292 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:14.809699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Launched 02:44:15.136247 run osmo-stp_10.42.42.5(pid=15223): Launched 02:44:15.260393 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:15.853729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15225): Launched 02:44:16.191397 run osmo-msc_10.42.42.6(pid=15226): Launched 02:44:16.614627 run osmo-stp_10.42.42.5(pid=15223): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] 02:44:16.860218 run osmo-stp_10.42.42.5(pid=15223): stdout: | (launched: 2022-12-10_02:44:15.076589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:17.040012 run osmo-stp_10.42.42.5(pid=15223): stderr: | [0;m[38;5;43m20221210024415269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024415269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024415270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024415270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024415270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024415270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024415271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:17.181885 run osmo-stp_10.42.42.5(pid=15223): stdout: | (launched: 2022-12-10_02:44:15.076589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:17.314789 run osmo-stp_10.42.42.5(pid=15223): stderr: | [0;m[38;5;43m20221210024415269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024415269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024415270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024415270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024415270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024415270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024415271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:17.472313 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15223): Process ended prematurely: osmo-stp_10.42.42.5(pid=15223) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:44:17.481978 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:44:17.509874 run osmo-hlr_10.42.42.2(pid=15220): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15220)] 02:44:17.559918 run osmo-hlr_10.42.42.2(pid=15220): stdout: | (launched: 2022-12-10_02:44:14.066579) 02:44:17.611828 run osmo-hlr_10.42.42.2(pid=15220): stderr: | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024414264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024414277 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024414285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024414285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024414285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:17.684348 run osmo-msc_10.42.42.6(pid=15226): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15226)] 02:44:17.734652 run osmo-msc_10.42.42.6(pid=15226): stdout: | (launched: 2022-12-10_02:44:16.129583) 02:44:17.786543 run osmo-msc_10.42.42.6(pid=15226): stderr: | [0;m[38;5;43m20221210024416562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024416562 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff09d152c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024416563 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024416563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024416563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024416563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024416565 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024416566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024416566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024416567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:17.838670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Terminating (SIGTERM) 02:44:17.880435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Terminating (SIGTERM) 02:44:17.922310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15225): Terminating (SIGTERM) 02:44:17.964425 --- ParallelTerminationStrategy: PID 15219 died... 02:44:17.984290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15219): Terminated: ok {rc=0} 02:44:18.030644 --- ParallelTerminationStrategy: PID 15222 died... 02:44:18.050316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15222): Terminated: ok {rc=0} 02:44:18.096556 --- ParallelTerminationStrategy: PID 15225 died... 02:44:18.116538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15225): Terminated: ok {rc=0} 02:44:18.204265 bus /sierra_3: Setting Powered False 02:44:19.304494 bus /sierra_3: Setting Powered False 02:44:20.420024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:44:21.565099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.576647 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:44:21.646608 tst mo_mt_call_osmux.py: using LAC 25438 02:44:21.766799 tst mo_mt_call_osmux.py: using RAC 193 02:44:21.886984 tst mo_mt_call_osmux.py: using CellId 25438 02:44:22.006819 tst mo_mt_call_osmux.py: using BVCI 25439 02:44:22.118491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:22.129649 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:22.140479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:22.151586 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:22.162989 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:22.174066 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:22.292644 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:22.417071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:22.922067 run create_hlr_db(pid=15228): Launched 02:44:23.054793 bus /sierra_2: Setting Powered False 02:44:24.118763 run create_hlr_db(pid=15228): Terminated: ok {rc=0} 02:44:24.552556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Launched 02:44:24.858045 run osmo-hlr_10.42.42.2(pid=15231): Launched 02:44:24.974724 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:25.512503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Launched 02:44:25.817613 run osmo-stp_10.42.42.5(pid=15234): Launched 02:44:25.934884 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:26.484161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15236): Launched 02:44:26.787592 run osmo-msc_10.42.42.6(pid=15237): Launched 02:44:26.957932 run osmo-stp_10.42.42.5(pid=15234): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] 02:44:27.087413 run osmo-stp_10.42.42.5(pid=15234): stdout: | (launched: 2022-12-10_02:44:25.761846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:27.216148 run osmo-stp_10.42.42.5(pid=15234): stderr: | [0;m[38;5;43m20221210024425933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024425933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024425934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024425934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:27.342727 run osmo-stp_10.42.42.5(pid=15234): stdout: | (launched: 2022-12-10_02:44:25.761846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:27.462776 run osmo-stp_10.42.42.5(pid=15234): stderr: | [0;m[38;5;43m20221210024425933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024425933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024425934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024425934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024425935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:27.606797 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15234): Process ended prematurely: osmo-stp_10.42.42.5(pid=15234) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:44:27.615546 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:44:27.642046 run osmo-hlr_10.42.42.2(pid=15231): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15231)] 02:44:27.689915 run osmo-hlr_10.42.42.2(pid=15231): stdout: | (launched: 2022-12-10_02:44:24.802291) 02:44:27.739029 run osmo-hlr_10.42.42.2(pid=15231): stderr: | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024424980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024424993 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024425003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024425003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024425003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:27.807863 run osmo-msc_10.42.42.6(pid=15237): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15237)] 02:44:27.855418 run osmo-msc_10.42.42.6(pid=15237): stdout: | (launched: 2022-12-10_02:44:26.731625) 02:44:27.904551 run osmo-msc_10.42.42.6(pid=15237): stderr: | [0;m[38;5;43m20221210024427003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024427003 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b905a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024427003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024427003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024427003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024427004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024427006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024427006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024427006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024427006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:27.954030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Terminating (SIGTERM) 02:44:27.993546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Terminating (SIGTERM) 02:44:28.033508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15236): Terminating (SIGTERM) 02:44:28.073452 --- ParallelTerminationStrategy: PID 15230 died... 02:44:28.092420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15230): Terminated: ok {rc=0} 02:44:28.136564 --- ParallelTerminationStrategy: PID 15233 died... 02:44:28.155128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15233): Terminated: ok {rc=0} 02:44:28.199080 --- ParallelTerminationStrategy: PID 15236 died... 02:44:28.217574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15236): Terminated: ok {rc=0} 02:44:28.301228 bus /sierra_3: Setting Powered False 02:44:29.397662 bus /sierra_3: Setting Powered False 02:44:30.510045 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:44:31.775080 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:31.782227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:44:31.816304 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:44:31.845577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:44:31.901009 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:44:31.942838 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:44:31.975674 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:44:32.508115 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:44:32.562275 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:32.574126 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:44:32.646210 tst mo_mt_call.py: using LAC 25439 02:44:32.779953 tst mo_mt_call.py: using RAC 194 02:44:32.906645 tst mo_mt_call.py: using CellId 25439 02:44:33.032379 tst mo_mt_call.py: using BVCI 25440 02:44:33.151307 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:33.162991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:33.174829 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:33.186292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:33.198375 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:33.210014 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:33.326998 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:33.444920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:33.915242 run create_hlr_db(pid=15242): Launched 02:44:34.032606 bus /sierra_2: Setting Powered False 02:44:35.092049 run create_hlr_db(pid=15242): Terminated: ok {rc=0} 02:44:35.536116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15244): Launched 02:44:35.859958 run osmo-hlr_10.42.42.2(pid=15245): Launched 02:44:35.983979 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:36.542707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15247): Launched 02:44:36.867630 run osmo-stp_10.42.42.5(pid=15248): Launched 02:44:36.991622 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:37.579385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15250): Launched 02:44:37.903962 run osmo-msc_10.42.42.6(pid=15251): Launched 02:44:38.085891 run osmo-stp_10.42.42.5(pid=15248): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15248)] 02:44:38.222916 run osmo-stp_10.42.42.5(pid=15248): stdout: | (launched: 2022-12-10_02:44:36.808682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:38.360388 run osmo-stp_10.42.42.5(pid=15248): stderr: | [0;m[38;5;43m20221210024437001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024437002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024437002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024437002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024437004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024437005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024437005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:38.496534 run osmo-stp_10.42.42.5(pid=15248): stdout: | (launched: 2022-12-10_02:44:36.808682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:38.625649 run osmo-stp_10.42.42.5(pid=15248): stderr: | [0;m[38;5;43m20221210024437001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024437002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024437002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024437002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024437004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024437005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024437005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:38.779924 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15248): Process ended prematurely: osmo-stp_10.42.42.5(pid=15248) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15248)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:44:38.789261 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:44:38.816824 run osmo-hlr_10.42.42.2(pid=15245): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15245)] 02:44:38.866869 run osmo-hlr_10.42.42.2(pid=15245): stdout: | (launched: 2022-12-10_02:44:35.801295) 02:44:38.918237 run osmo-hlr_10.42.42.2(pid=15245): stderr: | [0;m[1;31m20221210024436000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024436000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024436000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024436000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024436000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024436001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024436013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024436021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024436021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024436021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:38.990425 run osmo-msc_10.42.42.6(pid=15251): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15251)] 02:44:39.040342 run osmo-msc_10.42.42.6(pid=15251): stdout: | (launched: 2022-12-10_02:44:37.844762) 02:44:39.091853 run osmo-msc_10.42.42.6(pid=15251): stderr: | [0;m[38;5;43m20221210024438168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024438169 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65b7f23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024438169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024438169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024438169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024438170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024438171 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024438172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024438172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024438172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:39.144140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15244): Terminating (SIGTERM) 02:44:39.185702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15247): Terminating (SIGTERM) 02:44:39.227218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15250): Terminating (SIGTERM) 02:44:39.268684 --- ParallelTerminationStrategy: PID 15244 died... 02:44:39.288168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15244): Terminated: ok {rc=0} 02:44:39.333901 --- ParallelTerminationStrategy: PID 15247 died... 02:44:39.353313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15247): Terminated: ok {rc=0} 02:44:39.398693 --- ParallelTerminationStrategy: PID 15250 died... 02:44:39.417999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15250): Terminated: ok {rc=0} 02:44:39.504335 bus /sierra_3: Setting Powered False 02:44:40.603920 bus /sierra_3: Setting Powered False 02:44:41.720845 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:44:42.866883 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.878760 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:44:42.951966 tst mo_mt_call_osmux.py: using LAC 25440 02:44:43.082379 tst mo_mt_call_osmux.py: using RAC 195 02:44:43.210314 tst mo_mt_call_osmux.py: using CellId 25440 02:44:43.336545 tst mo_mt_call_osmux.py: using BVCI 25441 02:44:43.453921 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:43.465455 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:43.476711 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:43.488166 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:43.499596 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:43.510882 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:43.628872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:43.746598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:44.216767 run create_hlr_db(pid=15253): Launched 02:44:44.334472 bus /sierra_2: Setting Powered False 02:44:45.395116 run create_hlr_db(pid=15253): Terminated: ok {rc=0} 02:44:45.847008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Launched 02:44:46.205764 run osmo-hlr_10.42.42.2(pid=15257): Launched 02:44:46.347764 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:47.061980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Launched 02:44:47.394999 run osmo-stp_10.42.42.5(pid=15260): Launched 02:44:47.519185 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:48.105716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15262): Launched 02:44:48.430677 run osmo-msc_10.42.42.6(pid=15263): Launched 02:44:48.611347 run osmo-stp_10.42.42.5(pid=15260): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] 02:44:48.747774 run osmo-stp_10.42.42.5(pid=15260): stdout: | (launched: 2022-12-10_02:44:47.335770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:48.884709 run osmo-stp_10.42.42.5(pid=15260): stderr: | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024447530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:49.020535 run osmo-stp_10.42.42.5(pid=15260): stdout: | (launched: 2022-12-10_02:44:47.335770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:49.149190 run osmo-stp_10.42.42.5(pid=15260): stderr: | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024447529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024447530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024447531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:49.303139 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15260): Process ended prematurely: osmo-stp_10.42.42.5(pid=15260) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:44:49.312415 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:44:49.340176 run osmo-hlr_10.42.42.2(pid=15257): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15257)] 02:44:49.389832 run osmo-hlr_10.42.42.2(pid=15257): stdout: | (launched: 2022-12-10_02:44:46.140345) 02:44:49.441204 run osmo-hlr_10.42.42.2(pid=15257): stderr: | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024446532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024446551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024446577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024446577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024446577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:49.512621 run osmo-msc_10.42.42.6(pid=15263): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15263)] 02:44:49.562090 run osmo-msc_10.42.42.6(pid=15263): stdout: | (launched: 2022-12-10_02:44:48.371458) 02:44:49.613242 run osmo-msc_10.42.42.6(pid=15263): stderr: | [0;m[38;5;43m20221210024448696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024448696 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f35aac8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024448696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024448696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024448697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024448697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024448698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024448699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024448699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024448699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:49.664632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Terminating (SIGTERM) 02:44:49.705838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Terminating (SIGTERM) 02:44:49.746975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15262): Terminating (SIGTERM) 02:44:49.788648 --- ParallelTerminationStrategy: PID 15256 died... 02:44:49.808468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Terminated: ok {rc=0} 02:44:49.855449 --- ParallelTerminationStrategy: PID 15259 died... 02:44:49.874794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Terminated: ok {rc=0} 02:44:49.920016 --- ParallelTerminationStrategy: PID 15262 died... 02:44:49.939448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15262): Terminated: ok {rc=0} 02:44:50.026333 bus /sierra_3: Setting Powered False 02:44:51.125675 bus /sierra_3: Setting Powered False 02:44:52.241071 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:44:53.490678 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:53.497115 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:44:53.529848 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:44:53.559849 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:44:53.614565 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:44:53.648363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:44:53.675676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:44:54.227198 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:44:54.278793 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.290291 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:44:54.360055 tst mo_mt_call.py: using LAC 25441 02:44:54.489056 tst mo_mt_call.py: using RAC 196 02:44:54.616213 tst mo_mt_call.py: using CellId 25441 02:44:54.743344 tst mo_mt_call.py: using BVCI 25442 02:44:54.861305 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.872721 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.884046 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.895368 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.906899 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:44:54.918268 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:44:55.034388 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:44:55.152555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:55.654442 run create_hlr_db(pid=15268): Launched 02:44:55.786511 bus /sierra_2: Setting Powered False 02:44:56.850452 run create_hlr_db(pid=15268): Terminated: ok {rc=0} 02:44:57.301158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15270): Launched 02:44:57.625257 run osmo-hlr_10.42.42.2(pid=15271): Launched 02:44:57.749312 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:58.306110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15273): Launched 02:44:58.629922 run osmo-stp_10.42.42.5(pid=15274): Launched 02:44:58.753854 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:59.343144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15276): Launched 02:44:59.667797 run osmo-msc_10.42.42.6(pid=15277): Launched 02:44:59.848291 run osmo-stp_10.42.42.5(pid=15274): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15274)] 02:44:59.984310 run osmo-stp_10.42.42.5(pid=15274): stdout: | (launched: 2022-12-10_02:44:58.571144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:00.123247 run osmo-stp_10.42.42.5(pid=15274): stderr: | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024458765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:00.259992 run osmo-stp_10.42.42.5(pid=15274): stdout: | (launched: 2022-12-10_02:44:58.571144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:00.388317 run osmo-stp_10.42.42.5(pid=15274): stderr: | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024458765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024458765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024458766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:00.542340 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15274): Process ended prematurely: osmo-stp_10.42.42.5(pid=15274) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15274)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:45:00.551732 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:45:00.579370 run osmo-hlr_10.42.42.2(pid=15271): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15271)] 02:45:00.629253 run osmo-hlr_10.42.42.2(pid=15271): stdout: | (launched: 2022-12-10_02:44:57.566465) 02:45:00.680365 run osmo-hlr_10.42.42.2(pid=15271): stderr: | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024457765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024457778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024457786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024457786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024457786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:00.751873 run osmo-msc_10.42.42.6(pid=15277): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15277)] 02:45:00.801749 run osmo-msc_10.42.42.6(pid=15277): stdout: | (launched: 2022-12-10_02:44:59.608261) 02:45:00.866667 run osmo-msc_10.42.42.6(pid=15277): stderr: | [0;m[38;5;43m20221210024459932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024459932 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f989e192c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024459932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024459932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024459932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024459933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024459934 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024459935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024459935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024459935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:00.925092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15270): Terminating (SIGTERM) 02:45:00.967261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15273): Terminating (SIGTERM) 02:45:01.009466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15276): Terminating (SIGTERM) 02:45:01.052527 --- ParallelTerminationStrategy: PID 15270 died... 02:45:01.073163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15270): Terminated: ok {rc=0} 02:45:01.119825 --- ParallelTerminationStrategy: PID 15273 died... 02:45:01.140623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15273): Terminated: ok {rc=0} 02:45:01.196799 --- ParallelTerminationStrategy: PID 15276 died... 02:45:01.218455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15276): Terminated: ok {rc=0} 02:45:01.308395 bus /sierra_3: Setting Powered False 02:45:02.405418 bus /sierra_3: Setting Powered False 02:45:03.520796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:45:04.672526 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.684709 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:45:04.755750 tst mo_mt_call_osmux.py: using LAC 25442 02:45:04.885416 tst mo_mt_call_osmux.py: using RAC 197 02:45:05.012262 tst mo_mt_call_osmux.py: using CellId 25442 02:45:05.139577 tst mo_mt_call_osmux.py: using BVCI 25443 02:45:05.252317 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:05.263700 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:05.274886 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:05.286456 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:05.298133 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:05.309861 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:05.431635 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:05.551282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:06.056025 run create_hlr_db(pid=15282): Launched 02:45:06.189709 bus /sierra_2: Setting Powered False 02:45:07.254029 run create_hlr_db(pid=15282): Terminated: ok {rc=0} 02:45:07.688397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15284): Launched 02:45:07.995139 run osmo-hlr_10.42.42.2(pid=15285): Launched 02:45:08.112208 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:08.635071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15287): Launched 02:45:08.938884 run osmo-stp_10.42.42.5(pid=15288): Launched 02:45:09.054913 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:09.604599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15290): Launched 02:45:09.909449 run osmo-msc_10.42.42.6(pid=15291): Launched 02:45:10.082259 run osmo-stp_10.42.42.5(pid=15288): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15288)] 02:45:10.211981 run osmo-stp_10.42.42.5(pid=15288): stdout: | (launched: 2022-12-10_02:45:08.883164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:10.342295 run osmo-stp_10.42.42.5(pid=15288): stderr: | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024509053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:10.470679 run osmo-stp_10.42.42.5(pid=15288): stdout: | (launched: 2022-12-10_02:45:08.883164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:10.591940 run osmo-stp_10.42.42.5(pid=15288): stderr: | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024509052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024509053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024509055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:10.736929 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15288): Process ended prematurely: osmo-stp_10.42.42.5(pid=15288) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15288)] [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:45:10.746009 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:45:10.773356 run osmo-hlr_10.42.42.2(pid=15285): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15285)] 02:45:10.821696 run osmo-hlr_10.42.42.2(pid=15285): stdout: | (launched: 2022-12-10_02:45:07.938851) 02:45:10.871686 run osmo-hlr_10.42.42.2(pid=15285): stderr: | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024508114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024508126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024508138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024508138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024508138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:10.941358 run osmo-msc_10.42.42.6(pid=15291): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15291)] 02:45:10.989298 run osmo-msc_10.42.42.6(pid=15291): stdout: | (launched: 2022-12-10_02:45:09.853768) 02:45:11.039026 run osmo-msc_10.42.42.6(pid=15291): stderr: | [0;m[38;5;43m20221210024510125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024510125 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb41c863c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024510125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024510125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024510125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024510125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024510127 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024510127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024510128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024510128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:11.089449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15284): Terminating (SIGTERM) 02:45:11.129433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15287): Terminating (SIGTERM) 02:45:11.169847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15290): Terminating (SIGTERM) 02:45:11.210361 --- ParallelTerminationStrategy: PID 15284 died... 02:45:11.229550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15284): Terminated: ok {rc=0} 02:45:11.274391 --- ParallelTerminationStrategy: PID 15287 died... 02:45:11.293075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15287): Terminated: ok {rc=0} 02:45:11.337607 --- ParallelTerminationStrategy: PID 15290 died... 02:45:11.356229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15290): Terminated: ok {rc=0} 02:45:11.441038 bus /sierra_3: Setting Powered False 02:45:12.539577 bus /sierra_3: Setting Powered False 02:45:13.656912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:45:14.909955 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:14.916302 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:45:14.951567 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:45:14.978844 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:45:15.031703 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:45:15.064665 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:45:15.092176 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:45:15.641506 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:45:15.692594 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:15.703828 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:45:15.773908 tst mo_mt_call.py: using LAC 25443 02:45:15.936095 tst mo_mt_call.py: using RAC 198 02:45:16.060164 tst mo_mt_call.py: using CellId 25443 02:45:16.210022 tst mo_mt_call.py: using BVCI 25444 02:45:16.359403 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:16.372427 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:16.385772 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:16.403267 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:16.419110 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:16.434257 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:16.564254 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:16.711928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:17.245861 run create_hlr_db(pid=15296): Launched 02:45:17.398505 bus /sierra_2: Setting Powered False 02:45:18.458990 run create_hlr_db(pid=15296): Terminated: ok {rc=0} 02:45:18.882697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15298): Launched 02:45:19.187183 run osmo-hlr_10.42.42.2(pid=15299): Launched 02:45:19.304240 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:19.841406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15301): Launched 02:45:20.145533 run osmo-stp_10.42.42.5(pid=15302): Launched 02:45:20.261989 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:20.810363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15304): Launched 02:45:21.114912 run osmo-msc_10.42.42.6(pid=15305): Launched 02:45:21.285221 run osmo-stp_10.42.42.5(pid=15302): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15302)] 02:45:21.414014 run osmo-stp_10.42.42.5(pid=15302): stdout: | (launched: 2022-12-10_02:45:20.090154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:21.543830 run osmo-stp_10.42.42.5(pid=15302): stderr: | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024520260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024520262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024520263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024520263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:21.671465 run osmo-stp_10.42.42.5(pid=15302): stdout: | (launched: 2022-12-10_02:45:20.090154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:21.792405 run osmo-stp_10.42.42.5(pid=15302): stderr: | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024520259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024520260 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024520262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024520263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024520263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:21.937298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15302): Process ended prematurely: osmo-stp_10.42.42.5(pid=15302) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15302)] [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:45:21.945900 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:45:21.972929 run osmo-hlr_10.42.42.2(pid=15299): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15299)] 02:45:22.021991 run osmo-hlr_10.42.42.2(pid=15299): stdout: | (launched: 2022-12-10_02:45:19.131315) 02:45:22.071911 run osmo-hlr_10.42.42.2(pid=15299): stderr: | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024519309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024519321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024519332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024519332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024519332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:22.141511 run osmo-msc_10.42.42.6(pid=15305): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15305)] 02:45:22.188916 run osmo-msc_10.42.42.6(pid=15305): stdout: | (launched: 2022-12-10_02:45:21.058764) 02:45:22.238005 run osmo-msc_10.42.42.6(pid=15305): stderr: | [0;m[38;5;43m20221210024521334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024521334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff36c4e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024521334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024521334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024521334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024521334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024521336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024521337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024521337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024521337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:22.287816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15298): Terminating (SIGTERM) 02:45:22.327718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15301): Terminating (SIGTERM) 02:45:22.367655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15304): Terminating (SIGTERM) 02:45:22.407714 --- ParallelTerminationStrategy: PID 15298 died... 02:45:22.426929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15298): Terminated: ok {rc=0} 02:45:22.471594 --- ParallelTerminationStrategy: PID 15301 died... 02:45:22.490233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15301): Terminated: ok {rc=0} 02:45:22.534604 --- ParallelTerminationStrategy: PID 15304 died... 02:45:22.553529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15304): Terminated: ok {rc=0} 02:45:22.639795 bus /sierra_3: Setting Powered False 02:45:23.739885 bus /sierra_3: Setting Powered False 02:45:24.855759 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:45:26.002498 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.014454 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:45:26.096716 tst mo_mt_call_osmux.py: using LAC 25444 02:45:26.224066 tst mo_mt_call_osmux.py: using RAC 199 02:45:26.344793 tst mo_mt_call_osmux.py: using CellId 25444 02:45:26.462293 tst mo_mt_call_osmux.py: using BVCI 25445 02:45:26.574306 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.585680 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.596603 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.608011 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.619305 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:26.630542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:26.749147 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:26.873272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:27.378037 run create_hlr_db(pid=15307): Launched 02:45:27.511453 bus /sierra_2: Setting Powered False 02:45:28.575414 run create_hlr_db(pid=15307): Terminated: ok {rc=0} 02:45:29.008442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15309): Launched 02:45:29.313741 run osmo-hlr_10.42.42.2(pid=15310): Launched 02:45:29.430891 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:29.969136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15312): Launched 02:45:30.275086 run osmo-stp_10.42.42.5(pid=15313): Launched 02:45:30.392374 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:30.961052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15315): Launched 02:45:31.291360 run osmo-msc_10.42.42.6(pid=15316): Launched 02:45:31.831568 run osmo-stp_10.42.42.5(pid=15313): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15313)] 02:45:32.179363 run osmo-stp_10.42.42.5(pid=15313): stdout: | (launched: 2022-12-10_02:45:30.219061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:32.348038 run osmo-stp_10.42.42.5(pid=15313): stderr: | [0;m[38;5;43m20221210024530390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024530390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024530391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024530391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024530391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024530391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024530392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:32.482011 run osmo-stp_10.42.42.5(pid=15313): stdout: | (launched: 2022-12-10_02:45:30.219061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:32.603994 run osmo-stp_10.42.42.5(pid=15313): stderr: | [0;m[38;5;43m20221210024530390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024530390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024530391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024530391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024530391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024530391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024530392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:32.749511 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15313): Process ended prematurely: osmo-stp_10.42.42.5(pid=15313) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15313)] [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:45:32.758599 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 02:45:32.786069 run osmo-hlr_10.42.42.2(pid=15310): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15310)] 02:45:32.835624 run osmo-hlr_10.42.42.2(pid=15310): stdout: | (launched: 2022-12-10_02:45:29.258436) 02:45:32.885995 run osmo-hlr_10.42.42.2(pid=15310): stderr: | [0;m[1;31m20221210024529436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024529436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024529437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024529437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024529437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024529437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024529448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024529457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024529457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024529457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:32.956259 run osmo-msc_10.42.42.6(pid=15316): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15316)] 02:45:33.005057 run osmo-msc_10.42.42.6(pid=15316): stdout: | (launched: 2022-12-10_02:45:31.227750) 02:45:33.055370 run osmo-msc_10.42.42.6(pid=15316): stderr: | [0;m[38;5;43m20221210024531753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024531754 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a29578c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024531754 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024531754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024531754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024531755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024531758 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024531759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024531759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024531759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:33.106090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15309): Terminating (SIGTERM) 02:45:33.147019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15312): Terminating (SIGTERM) 02:45:33.188001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15315): Terminating (SIGTERM) 02:45:33.229206 --- ParallelTerminationStrategy: PID 15309 died... 02:45:33.248665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15309): Terminated: ok {rc=0} 02:45:33.295004 --- ParallelTerminationStrategy: PID 15312 died... 02:45:33.313953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15312): Terminated: ok {rc=0} 02:45:33.359904 --- ParallelTerminationStrategy: PID 15315 died... 02:45:33.378893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15315): Terminated: ok {rc=0} 02:45:33.465140 bus /sierra_3: Setting Powered False 02:45:34.565047 bus /sierra_3: Setting Powered False 02:45:35.681879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:45:36.934905 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:36.940777 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:45:36.974480 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:45:37.002255 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:45:37.060761 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:45:37.093912 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:45:37.121049 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:45:37.666809 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:45:37.718489 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:37.729909 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:45:37.800101 tst mo_mt_call.py: using LAC 25445 02:45:37.925542 tst mo_mt_call.py: using RAC 200 02:45:38.051609 tst mo_mt_call.py: using CellId 25445 02:45:38.182816 tst mo_mt_call.py: using BVCI 25446 02:45:38.301599 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:38.312810 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:38.323900 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:38.335093 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:38.346326 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:38.357501 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:38.472329 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:38.588048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:39.059974 run create_hlr_db(pid=15321): Launched 02:45:39.178337 bus /sierra_2: Setting Powered False 02:45:40.239600 run create_hlr_db(pid=15321): Terminated: ok {rc=0} 02:45:40.685421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Launched 02:45:41.012688 run osmo-hlr_10.42.42.2(pid=15324): Launched 02:45:41.140527 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:41.702522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Launched 02:45:42.028614 run osmo-stp_10.42.42.5(pid=15327): Launched 02:45:42.153867 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:42.741154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Launched 02:45:43.065663 run osmo-msc_10.42.42.6(pid=15330): Launched 02:45:43.248840 run osmo-stp_10.42.42.5(pid=15327): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] 02:45:43.387138 run osmo-stp_10.42.42.5(pid=15327): stdout: | (launched: 2022-12-10_02:45:41.969630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:43.525269 run osmo-stp_10.42.42.5(pid=15327): stderr: | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024542162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:43.662318 run osmo-stp_10.42.42.5(pid=15327): stdout: | (launched: 2022-12-10_02:45:41.969630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:43.792310 run osmo-stp_10.42.42.5(pid=15327): stderr: | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024542162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024542162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024542165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:43.947282 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15327): Process ended prematurely: osmo-stp_10.42.42.5(pid=15327) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:45:43.956530 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:45:43.984122 run osmo-hlr_10.42.42.2(pid=15324): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15324)] 02:45:44.034016 run osmo-hlr_10.42.42.2(pid=15324): stdout: | (launched: 2022-12-10_02:45:40.953516) 02:45:44.085519 run osmo-hlr_10.42.42.2(pid=15324): stderr: | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024541153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024541165 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024541174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024541174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024541174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:44.157990 run osmo-msc_10.42.42.6(pid=15330): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15330)] 02:45:44.208176 run osmo-msc_10.42.42.6(pid=15330): stdout: | (launched: 2022-12-10_02:45:43.006646) 02:45:44.259693 run osmo-msc_10.42.42.6(pid=15330): stderr: | [0;m[38;5;43m20221210024543326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024543326 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6bdce9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024543326 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024543326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024543327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024543327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024543330 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024543332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024543332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024543332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:44.311732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Terminating (SIGTERM) 02:45:44.353521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Terminating (SIGTERM) 02:45:44.395344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Terminating (SIGTERM) 02:45:44.437734 --- ParallelTerminationStrategy: PID 15323 died... 02:45:44.457740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Terminated: ok {rc=0} 02:45:44.504008 --- ParallelTerminationStrategy: PID 15326 died... 02:45:44.523651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Terminated: ok {rc=0} 02:45:44.569756 --- ParallelTerminationStrategy: PID 15329 died... 02:45:44.589522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Terminated: ok {rc=0} 02:45:44.676841 bus /sierra_3: Setting Powered False 02:45:45.775092 bus /sierra_3: Setting Powered False 02:45:46.892585 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:45:48.049489 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.061256 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:45:48.131379 tst mo_mt_call_osmux.py: using LAC 25446 02:45:48.261398 tst mo_mt_call_osmux.py: using RAC 201 02:45:48.388829 tst mo_mt_call_osmux.py: using CellId 25446 02:45:48.515853 tst mo_mt_call_osmux.py: using BVCI 25447 02:45:48.633667 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.645142 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.656297 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.667820 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.679113 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:48.690396 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:48.806086 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:48.924922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:49.430244 run create_hlr_db(pid=15332): Launched 02:45:49.563252 bus /sierra_2: Setting Powered False 02:45:50.627546 run create_hlr_db(pid=15332): Terminated: ok {rc=0} 02:45:51.061432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15334): Launched 02:45:51.367149 run osmo-hlr_10.42.42.2(pid=15335): Launched 02:45:51.483912 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:52.011093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15337): Launched 02:45:52.315476 run osmo-stp_10.42.42.5(pid=15338): Launched 02:45:52.433799 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:52.989188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15340): Launched 02:45:53.293231 run osmo-msc_10.42.42.6(pid=15341): Launched 02:45:53.464296 run osmo-stp_10.42.42.5(pid=15338): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15338)] 02:45:53.593484 run osmo-stp_10.42.42.5(pid=15338): stdout: | (launched: 2022-12-10_02:45:52.259508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:53.722710 run osmo-stp_10.42.42.5(pid=15338): stderr: | [0;m[38;5;43m20221210024552432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024552432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024552433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024552433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:53.849769 run osmo-stp_10.42.42.5(pid=15338): stdout: | (launched: 2022-12-10_02:45:52.259508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:53.970113 run osmo-stp_10.42.42.5(pid=15338): stderr: | [0;m[38;5;43m20221210024552432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024552432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024552433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024552433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024552434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:54.114741 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15338): Process ended prematurely: osmo-stp_10.42.42.5(pid=15338) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15338)] [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:45:54.123451 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:45:54.150485 run osmo-hlr_10.42.42.2(pid=15335): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15335)] 02:45:54.198571 run osmo-hlr_10.42.42.2(pid=15335): stdout: | (launched: 2022-12-10_02:45:51.311292) 02:45:54.248259 run osmo-hlr_10.42.42.2(pid=15335): stderr: | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024551489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024551501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024551509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024551510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024551510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:54.317345 run osmo-msc_10.42.42.6(pid=15341): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15341)] 02:45:54.365541 run osmo-msc_10.42.42.6(pid=15341): stdout: | (launched: 2022-12-10_02:45:53.237539) 02:45:54.415303 run osmo-msc_10.42.42.6(pid=15341): stderr: | [0;m[38;5;43m20221210024553508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024553508 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb723267c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024553508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024553508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024553508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024553509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024553512 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024553512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024553513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024553513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:54.466056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15334): Terminating (SIGTERM) 02:45:54.506015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15337): Terminating (SIGTERM) 02:45:54.545836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15340): Terminating (SIGTERM) 02:45:54.585967 --- ParallelTerminationStrategy: PID 15334 died... 02:45:54.605148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15334): Terminated: ok {rc=0} 02:45:54.649474 --- ParallelTerminationStrategy: PID 15337 died... 02:45:54.667845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15337): Terminated: ok {rc=0} 02:45:54.712022 --- ParallelTerminationStrategy: PID 15340 died... 02:45:54.730588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15340): Terminated: ok {rc=0} 02:45:54.816437 bus /sierra_3: Setting Powered False 02:45:55.916263 bus /sierra_3: Setting Powered False 02:45:57.032662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:45:58.284681 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:58.291195 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:45:58.324858 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:45:58.352568 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:45:58.404793 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:45:58.438322 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:45:58.465891 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:45:59.019215 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:45:59.071767 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.083764 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:45:59.137579 tst mo_mt_call.py: using LAC 25447 02:45:59.267802 tst mo_mt_call.py: using RAC 202 02:45:59.397891 tst mo_mt_call.py: using CellId 25447 02:45:59.524938 tst mo_mt_call.py: using BVCI 25448 02:45:59.642991 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.654755 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.666397 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.678106 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.689969 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:45:59.701733 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:45:59.819386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:45:59.934807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:00.405757 run create_hlr_db(pid=15346): Launched 02:46:00.522936 bus /sierra_2: Setting Powered False 02:46:01.587671 run create_hlr_db(pid=15346): Terminated: ok {rc=0} 02:46:02.056038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15348): Launched 02:46:02.393560 run osmo-hlr_10.42.42.2(pid=15349): Launched 02:46:02.518247 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:03.077745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15351): Launched 02:46:03.404356 run osmo-stp_10.42.42.5(pid=15352): Launched 02:46:03.528852 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:04.117228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15354): Launched 02:46:04.442575 run osmo-msc_10.42.42.6(pid=15355): Launched 02:46:04.625059 run osmo-stp_10.42.42.5(pid=15352): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15352)] 02:46:04.761757 run osmo-stp_10.42.42.5(pid=15352): stdout: | (launched: 2022-12-10_02:46:03.345467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:04.899113 run osmo-stp_10.42.42.5(pid=15352): stderr: | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024603538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:05.035853 run osmo-stp_10.42.42.5(pid=15352): stdout: | (launched: 2022-12-10_02:46:03.345467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:05.165231 run osmo-stp_10.42.42.5(pid=15352): stderr: | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024603537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024603538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024603540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:05.319464 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15352): Process ended prematurely: osmo-stp_10.42.42.5(pid=15352) [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15352)] [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:46:05.329122 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:46:05.357274 run osmo-hlr_10.42.42.2(pid=15349): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15349)] 02:46:05.407364 run osmo-hlr_10.42.42.2(pid=15349): stdout: | (launched: 2022-12-10_02:46:02.334259) 02:46:05.459180 run osmo-hlr_10.42.42.2(pid=15349): stderr: | [0;m[1;31m20221210024602534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024602534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024602534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024602535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024602535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024602535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024602546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024602554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024602554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024602554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:05.531401 run osmo-msc_10.42.42.6(pid=15355): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15355)] 02:46:05.581318 run osmo-msc_10.42.42.6(pid=15355): stdout: | (launched: 2022-12-10_02:46:04.383552) 02:46:05.632436 run osmo-msc_10.42.42.6(pid=15355): stderr: | [0;m[38;5;43m20221210024604705 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024604705 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3589581c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024604705 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024604706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024604706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024604706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024604707 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024604708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024604708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024604708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:05.684071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15348): Terminating (SIGTERM) 02:46:05.725558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15351): Terminating (SIGTERM) 02:46:05.767321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15354): Terminating (SIGTERM) 02:46:05.809372 --- ParallelTerminationStrategy: PID 15348 died... 02:46:05.829401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15348): Terminated: ok {rc=0} 02:46:05.876237 --- ParallelTerminationStrategy: PID 15351 died... 02:46:05.896125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15351): Terminated: ok {rc=0} 02:46:05.942411 --- ParallelTerminationStrategy: PID 15354 died... 02:46:05.962018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15354): Terminated: ok {rc=0} 02:46:06.049544 bus /sierra_3: Setting Powered False 02:46:07.149438 bus /sierra_3: Setting Powered False 02:46:08.266258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:46:09.416653 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:09.429259 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:46:09.483699 tst mo_mt_call_osmux.py: using LAC 25448 02:46:09.611588 tst mo_mt_call_osmux.py: using RAC 203 02:46:09.740931 tst mo_mt_call_osmux.py: using CellId 25448 02:46:09.868928 tst mo_mt_call_osmux.py: using BVCI 25449 02:46:09.988124 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:09.999877 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:10.011452 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:10.023271 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:10.035194 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:10.046847 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:10.167390 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:10.285235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:10.757045 run create_hlr_db(pid=15357): Launched 02:46:10.875484 bus /sierra_2: Setting Powered False 02:46:11.936085 run create_hlr_db(pid=15357): Terminated: ok {rc=0} 02:46:12.381372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15359): Launched 02:46:12.709138 run osmo-hlr_10.42.42.2(pid=15360): Launched 02:46:12.834518 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:13.401161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15362): Launched 02:46:13.727242 run osmo-stp_10.42.42.5(pid=15363): Launched 02:46:13.851686 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:14.441195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15365): Launched 02:46:14.767531 run osmo-msc_10.42.42.6(pid=15366): Launched 02:46:14.949563 run osmo-stp_10.42.42.5(pid=15363): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15363)] 02:46:15.086392 run osmo-stp_10.42.42.5(pid=15363): stdout: | (launched: 2022-12-10_02:46:13.667769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:15.224561 run osmo-stp_10.42.42.5(pid=15363): stderr: | [0;m[38;5;43m20221210024613863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024613864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024613864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024613864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:15.361575 run osmo-stp_10.42.42.5(pid=15363): stdout: | (launched: 2022-12-10_02:46:13.667769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:15.490764 run osmo-stp_10.42.42.5(pid=15363): stderr: | [0;m[38;5;43m20221210024613863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024613864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024613864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024613864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024613865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:15.645790 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15363): Process ended prematurely: osmo-stp_10.42.42.5(pid=15363) [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15363)] [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:46:15.655417 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:46:15.683380 run osmo-hlr_10.42.42.2(pid=15360): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15360)] 02:46:15.733744 run osmo-hlr_10.42.42.2(pid=15360): stdout: | (launched: 2022-12-10_02:46:12.649777) 02:46:15.786029 run osmo-hlr_10.42.42.2(pid=15360): stderr: | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024612850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024612863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024612871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024612871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024612871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:15.859729 run osmo-msc_10.42.42.6(pid=15366): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15366)] 02:46:15.913794 run osmo-msc_10.42.42.6(pid=15366): stdout: | (launched: 2022-12-10_02:46:14.707788) 02:46:15.970476 run osmo-msc_10.42.42.6(pid=15366): stderr: | [0;m[38;5;43m20221210024615030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024615031 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98780bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024615031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024615031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024615031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024615031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024615033 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024615033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024615033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024615033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:16.023711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15359): Terminating (SIGTERM) 02:46:16.067176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15362): Terminating (SIGTERM) 02:46:16.111772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15365): Terminating (SIGTERM) 02:46:16.157028 --- ParallelTerminationStrategy: PID 15359 died... 02:46:16.177794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15359): Terminated: ok {rc=0} 02:46:16.226492 --- ParallelTerminationStrategy: PID 15362 died... 02:46:16.246821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15362): Terminated: ok {rc=0} 02:46:16.293944 --- ParallelTerminationStrategy: PID 15365 died... 02:46:16.314132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15365): Terminated: ok {rc=0} 02:46:16.409777 bus /sierra_3: Setting Powered False 02:46:17.519211 bus /sierra_3: Setting Powered False 02:46:18.635285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:trx-umtrx --------------------------------------------------------------------- 02:46:19.892545 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:19.897382 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:46:19.930507 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:46:19.958342 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:46:20.043146 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:46:20.076456 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:46:20.103995 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:46:20.690949 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 02:46:20.696446 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:20.707777 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:20.762115 tst emergency_mo_mt_call.py: using LAC 25449 02:46:20.887301 tst emergency_mo_mt_call.py: using RAC 204 02:46:21.012490 tst emergency_mo_mt_call.py: using CellId 25449 02:46:21.136595 tst emergency_mo_mt_call.py: using BVCI 25450 02:46:21.246778 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:21.257481 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:21.267899 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:21.279134 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:21.290401 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:21.301510 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:21.421793 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:21.539541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:22.003311 run create_hlr_db(pid=15371): Launched 02:46:22.116823 bus /sierra_2: Setting Powered False 02:46:23.176881 run create_hlr_db(pid=15371): Terminated: ok {rc=0} 02:46:23.594107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15373): Launched 02:46:23.892589 run osmo-hlr_10.42.42.2(pid=15374): Launched 02:46:24.007143 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:24.536093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15376): Launched 02:46:24.835845 run osmo-stp_10.42.42.5(pid=15377): Launched 02:46:24.959285 tst emergency_mo_mt_call.py: using MSISDN 7510 02:46:25.116208 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:25.654985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15379): Launched 02:46:25.955569 run osmo-msc_10.42.42.6(pid=15380): Launched 02:46:26.124489 run osmo-stp_10.42.42.5(pid=15377): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15377)] 02:46:26.252474 run osmo-stp_10.42.42.5(pid=15377): stdout: | (launched: 2022-12-10_02:46:24.780644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:26.380535 run osmo-stp_10.42.42.5(pid=15377): stderr: | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024624953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024624953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024624953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024624954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:26.506792 run osmo-stp_10.42.42.5(pid=15377): stdout: | (launched: 2022-12-10_02:46:24.780644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:26.626144 run osmo-stp_10.42.42.5(pid=15377): stderr: | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024624952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024624953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024624953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024624953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024624954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:26.768669 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15377): Process ended prematurely: osmo-stp_10.42.42.5(pid=15377) [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15377)] [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 02:46:26.776848 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 02:46:26.803075 run osmo-hlr_10.42.42.2(pid=15374): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15374)] 02:46:26.851479 run osmo-hlr_10.42.42.2(pid=15374): stdout: | (launched: 2022-12-10_02:46:23.837794) 02:46:26.901333 run osmo-hlr_10.42.42.2(pid=15374): stderr: | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024624014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024624029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024624039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024624039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024624039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:26.970802 run osmo-msc_10.42.42.6(pid=15380): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15380)] 02:46:27.018948 run osmo-msc_10.42.42.6(pid=15380): stdout: | (launched: 2022-12-10_02:46:25.900312) 02:46:27.068871 run osmo-msc_10.42.42.6(pid=15380): stderr: | [0;m[38;5;43m20221210024626172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024626172 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04e41d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024626172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024626172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024626172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024626173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024626174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024626175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024626175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024626175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:27.119322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15373): Terminating (SIGTERM) 02:46:27.159460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15376): Terminating (SIGTERM) 02:46:27.199654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15379): Terminating (SIGTERM) 02:46:27.239978 --- ParallelTerminationStrategy: PID 15373 died... 02:46:27.259095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15373): Terminated: ok {rc=0} 02:46:27.303651 --- ParallelTerminationStrategy: PID 15376 died... 02:46:27.322514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15376): Terminated: ok {rc=0} 02:46:27.367469 --- ParallelTerminationStrategy: PID 15379 died... 02:46:27.386164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15379): Terminated: ok {rc=0} 02:46:27.472578 bus /sierra_3: Setting Powered False 02:46:28.572513 bus /sierra_3: Setting Powered False 02:46:29.688185 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 02:46:30.778184 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:30.790144 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:30.846089 tst emergency_preemptive_call.py: using LAC 25450 02:46:30.991229 tst emergency_preemptive_call.py: using RAC 205 02:46:31.120250 tst emergency_preemptive_call.py: using CellId 25450 02:46:31.241940 tst emergency_preemptive_call.py: using BVCI 25451 02:46:31.354763 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:31.366517 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:31.378174 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:31.391718 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:31.403367 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:31.415631 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:31.537048 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:31.663785 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:31.815910 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:31.946978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:32.422259 run create_hlr_db(pid=15382): Launched 02:46:32.538380 bus /sierra_2: Setting Powered False 02:46:33.599381 run create_hlr_db(pid=15382): Terminated: ok {rc=0} 02:46:34.018991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15384): Launched 02:46:34.318860 run osmo-hlr_10.42.42.2(pid=15385): Launched 02:46:34.431974 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:34.945060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15387): Launched 02:46:35.244760 run osmo-stp_10.42.42.5(pid=15388): Launched 02:46:35.369597 tst emergency_preemptive_call.py: using MSISDN 7511 02:46:35.527593 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:36.063475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15390): Launched 02:46:36.362338 run osmo-msc_10.42.42.6(pid=15391): Launched 02:46:36.529616 run osmo-stp_10.42.42.5(pid=15388): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15388)] 02:46:36.656628 run osmo-stp_10.42.42.5(pid=15388): stdout: | (launched: 2022-12-10_02:46:35.189512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:36.784292 run osmo-stp_10.42.42.5(pid=15388): stderr: | [0;m[38;5;43m20221210024635360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024635361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024635361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024635361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:36.909871 run osmo-stp_10.42.42.5(pid=15388): stdout: | (launched: 2022-12-10_02:46:35.189512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:37.028833 run osmo-stp_10.42.42.5(pid=15388): stderr: | [0;m[38;5;43m20221210024635360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024635361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024635361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024635361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024635363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:37.171283 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15388): Process ended prematurely: osmo-stp_10.42.42.5(pid=15388) [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15388)] [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 02:46:37.179579 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 02:46:37.206083 run osmo-hlr_10.42.42.2(pid=15385): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15385)] 02:46:37.254703 run osmo-hlr_10.42.42.2(pid=15385): stdout: | (launched: 2022-12-10_02:46:34.263950) 02:46:37.304559 run osmo-hlr_10.42.42.2(pid=15385): stderr: | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024634442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024634454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024634463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024634463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024634463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:37.374607 run osmo-msc_10.42.42.6(pid=15391): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15391)] 02:46:37.422874 run osmo-msc_10.42.42.6(pid=15391): stdout: | (launched: 2022-12-10_02:46:36.307556) 02:46:37.472764 run osmo-msc_10.42.42.6(pid=15391): stderr: | [0;m[38;5;43m20221210024636578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210024636578 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0a491cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210024636578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210024636578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210024636578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210024636579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210024636581 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210024636582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210024636582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210024636582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:37.522924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15384): Terminating (SIGTERM) 02:46:37.563038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15387): Terminating (SIGTERM) 02:46:37.603297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15390): Terminating (SIGTERM) 02:46:37.644225 --- ParallelTerminationStrategy: PID 15384 died... 02:46:37.663572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15384): Terminated: ok {rc=0} 02:46:37.708187 --- ParallelTerminationStrategy: PID 15387 died... 02:46:37.726948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15387): Terminated: ok {rc=0} 02:46:37.771372 --- ParallelTerminationStrategy: PID 15390 died... 02:46:37.790170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15390): Terminated: ok {rc=0} 02:46:37.875276 bus /sierra_9: Setting Powered False 02:46:38.973855 bus /sierra_9: Setting Powered False 02:46:40.093151 bus /sierra_8: Setting Powered False 02:46:41.191671 bus /sierra_8: Setting Powered False 02:46:42.307320 bus /sierra_3: Setting Powered False 02:46:43.405659 bus /sierra_3: Setting Powered False 02:46:44.522215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx --------------------------------------------------------------------- 02:46:45.798283 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:45.803836 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:46:45.838687 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 02:46:45.901734 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:46:46.001312 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:46:46.045892 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 02:46:46.087365 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:46:46.691188 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 02:46:46.762542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:46.776897 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:46.835124 tst cs_paging_gprs_active.py: using LAC 25451 02:46:46.992246 tst cs_paging_gprs_active.py: using RAC 206 02:46:47.146396 tst cs_paging_gprs_active.py: using CellId 25451 02:46:47.276463 tst cs_paging_gprs_active.py: using BVCI 25452 02:46:47.396503 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.407734 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.418665 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.429636 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.440383 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.451185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.462262 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.472934 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:47.484322 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:47.606097 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:47.725534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:46:47.947186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:46:48.276275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15397): Launched 02:46:48.560449 run iperf3-srv_10.42.42.10(pid=15398): Launched 02:46:48.683728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:46:48.904003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:46:49.231962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15399): Launched 02:46:49.516573 run iperf3-srv_10.42.42.10(pid=15400): Launched 02:46:49.639676 tst cs_paging_gprs_active.py:38: start network... 02:46:49.859261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:50.367501 run create_hlr_db(pid=15401): Launched 02:46:50.501393 bus /sierra_2: Setting Powered False 02:46:51.566730 run create_hlr_db(pid=15401): Terminated: ok {rc=0} 02:46:52.021077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15403): Launched 02:46:52.349910 run osmo-hlr_10.42.42.2(pid=15404): Launched 02:46:52.475464 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:53.036370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15406): Launched 02:46:53.364328 run osmo-stp_10.42.42.5(pid=15407): Launched 02:46:53.490182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:46:54.052505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15409): Launched 02:46:54.177610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:46:54.454175 run patchelf(pid=15410): Launched 02:46:54.635910 run osmo-stp_10.42.42.5(pid=15407): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15407)] 02:46:54.774159 run osmo-stp_10.42.42.5(pid=15407): stdout: | (launched: 2022-12-10_02:46:53.304678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:54.913870 run osmo-stp_10.42.42.5(pid=15407): stderr: | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024653499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:55.053692 run osmo-stp_10.42.42.5(pid=15407): stdout: | (launched: 2022-12-10_02:46:53.304678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:55.188020 run osmo-stp_10.42.42.5(pid=15407): stderr: | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024653498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024653499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024653499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:55.347259 run patchelf(pid=15410): Terminating (SIGINT) 02:46:55.530238 run patchelf(pid=15410): Terminated: ok {rc=0} 02:46:55.662311 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15407): Process ended prematurely: osmo-stp_10.42.42.5(pid=15407) [trial-2368↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15407)] [trial-2368↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 02:46:55.672243 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 02:46:55.700817 run osmo-hlr_10.42.42.2(pid=15404): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15404)] 02:46:55.751191 run osmo-hlr_10.42.42.2(pid=15404): stdout: | (launched: 2022-12-10_02:46:52.289725) 02:46:55.803438 run osmo-hlr_10.42.42.2(pid=15404): stderr: | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024652490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024652503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024652511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024652511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024652511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:55.855891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15397): Terminating (SIGTERM) 02:46:55.897979 run iperf3-srv_10.42.42.10(pid=15398): Terminating (SIGTERM) 02:46:55.939758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15399): Terminating (SIGTERM) 02:46:55.981403 run iperf3-srv_10.42.42.10(pid=15400): Terminating (SIGTERM) 02:46:56.022928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15403): Terminating (SIGTERM) 02:46:56.064588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15406): Terminating (SIGTERM) 02:46:56.106350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15409): Terminating (SIGTERM) 02:46:56.148349 --- ParallelTerminationStrategy: PID 15397 died... 02:46:56.168056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15397): Terminated: ok {rc=0} 02:46:56.214269 --- ParallelTerminationStrategy: PID 15398 died... 02:46:56.233477 run iperf3-srv_10.42.42.10(pid=15398): Terminated {rc=256} 02:46:56.279795 --- ParallelTerminationStrategy: PID 15399 died... 02:46:56.299341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15399): Terminated: ok {rc=0} 02:46:56.345575 --- ParallelTerminationStrategy: PID 15400 died... 02:46:56.365107 run iperf3-srv_10.42.42.10(pid=15400): Terminated {rc=256} 02:46:56.410591 --- ParallelTerminationStrategy: PID 15403 died... 02:46:56.429995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15403): Terminated: ok {rc=0} 02:46:56.475490 --- ParallelTerminationStrategy: PID 15406 died... 02:46:56.495058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15406): Terminated: ok {rc=0} 02:46:56.540828 --- ParallelTerminationStrategy: PID 15409 died... 02:46:56.560783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15409): Terminated: ok {rc=0} 02:46:56.649981 bus /gobi_0: Setting Powered False 02:46:57.750841 bus /gobi_0: Setting Powered False 02:46:58.867170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx iperf3.py ---------------------------------------------- 02:47:00.017865 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.029703 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:00.081761 tst iperf3.py: using LAC 25452 02:47:00.211871 tst iperf3.py: using RAC 207 02:47:00.340689 tst iperf3.py: using CellId 25452 02:47:00.470340 tst iperf3.py: using BVCI 25453 02:47:00.589390 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.600449 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.611328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.622257 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.632931 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.643729 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.654823 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.665674 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:00.676637 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:00.796184 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:01.019533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:01.353721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15411): Launched 02:47:01.653889 run iperf3-srv_10.42.42.10(pid=15412): Launched 02:47:01.780243 tst iperf3.py:8: start network... 02:47:02.004819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:02.515307 run create_hlr_db(pid=15413): Launched 02:47:02.649171 bus /gobi_6: Setting Powered False 02:47:03.713968 run create_hlr_db(pid=15413): Terminated: ok {rc=0} 02:47:04.166590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Launched 02:47:04.493893 run osmo-hlr_10.42.42.2(pid=15416): Launched 02:47:04.618150 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:05.184749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Launched 02:47:05.511060 run osmo-stp_10.42.42.5(pid=15419): Launched 02:47:05.635127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:06.197632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15421): Launched 02:47:06.323977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:06.601864 run patchelf(pid=15422): Launched 02:47:06.784086 run osmo-stp_10.42.42.5(pid=15419): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] 02:47:06.922492 run osmo-stp_10.42.42.5(pid=15419): stdout: | (launched: 2022-12-10_02:47:05.451585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:07.062208 run osmo-stp_10.42.42.5(pid=15419): stderr: | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024705646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:07.202389 run osmo-stp_10.42.42.5(pid=15419): stdout: | (launched: 2022-12-10_02:47:05.451585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:07.336807 run osmo-stp_10.42.42.5(pid=15419): stderr: | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024705645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024705646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024705646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:07.496083 run patchelf(pid=15422): Terminating (SIGINT) 02:47:07.679409 run patchelf(pid=15422): Terminated: ok {rc=0} 02:47:07.811184 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15419): Process ended prematurely: osmo-stp_10.42.42.5(pid=15419) [trial-2368↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] [trial-2368↪gprs:trx-umtrx↪iperf3.py:8] 02:47:07.821052 tst iperf3.py:8: Test FAILED (7.8 sec) 02:47:07.849721 run osmo-hlr_10.42.42.2(pid=15416): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15416)] 02:47:07.900494 run osmo-hlr_10.42.42.2(pid=15416): stdout: | (launched: 2022-12-10_02:47:04.434132) 02:47:07.953107 run osmo-hlr_10.42.42.2(pid=15416): stderr: | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024704634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024704647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024704655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024704655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024704655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:08.005898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15411): Terminating (SIGTERM) 02:47:08.048383 run iperf3-srv_10.42.42.10(pid=15412): Terminating (SIGTERM) 02:47:08.091511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Terminating (SIGTERM) 02:47:08.134047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Terminating (SIGTERM) 02:47:08.176406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15421): Terminating (SIGTERM) 02:47:08.219668 --- ParallelTerminationStrategy: PID 15411 died... 02:47:08.240076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15411): Terminated: ok {rc=0} 02:47:08.287110 --- ParallelTerminationStrategy: PID 15412 died... 02:47:08.307024 run iperf3-srv_10.42.42.10(pid=15412): Terminated {rc=256} 02:47:08.353954 --- ParallelTerminationStrategy: PID 15415 died... 02:47:08.374123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Terminated: ok {rc=0} 02:47:08.420892 --- ParallelTerminationStrategy: PID 15418 died... 02:47:08.441139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Terminated: ok {rc=0} 02:47:08.487780 --- ParallelTerminationStrategy: PID 15421 died... 02:47:08.507555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15421): Terminated: ok {rc=0} 02:47:08.595869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 02:47:09.746885 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.758477 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:09.808012 tst iperf3m4.py: using LAC 25453 02:47:09.938372 tst iperf3m4.py: using RAC 208 02:47:10.067891 tst iperf3m4.py: using CellId 25453 02:47:10.190392 tst iperf3m4.py: using BVCI 25454 02:47:10.305170 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.316012 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.326736 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.337888 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.349267 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.360391 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.371741 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.383290 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:10.394597 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:10.515606 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:10.639248 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:10.758955 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:10.880016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:11.101072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:11.429245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15423): Launched 02:47:11.713573 run iperf3-srv_10.42.42.10(pid=15424): Launched 02:47:11.837290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:47:12.057625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:12.386431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15425): Launched 02:47:12.671137 run iperf3-srv_10.42.42.10(pid=15426): Launched 02:47:12.794576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:47:13.014675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:13.342963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15427): Launched 02:47:13.627034 run iperf3-srv_10.42.42.10(pid=15428): Launched 02:47:13.750057 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:47:13.970305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:14.298065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15429): Launched 02:47:14.583527 run iperf3-srv_10.42.42.10(pid=15430): Launched 02:47:14.706465 tst iperf3m4.py:8: start network... 02:47:14.926467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:15.434619 run create_hlr_db(pid=15431): Launched 02:47:15.567328 bus /gobi_6: Setting Powered False 02:47:16.634779 run create_hlr_db(pid=15431): Terminated: ok {rc=0} 02:47:17.069438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15433): Launched 02:47:17.381368 run osmo-hlr_10.42.42.2(pid=15434): Launched 02:47:17.501957 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:18.044022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15436): Launched 02:47:18.351744 run osmo-stp_10.42.42.5(pid=15437): Launched 02:47:18.470320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:18.998165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15439): Launched 02:47:19.115499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:19.374207 run patchelf(pid=15440): Launched 02:47:19.545086 run osmo-stp_10.42.42.5(pid=15437): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15437)] 02:47:19.674674 run osmo-stp_10.42.42.5(pid=15437): stdout: | (launched: 2022-12-10_02:47:18.295162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:19.805180 run osmo-stp_10.42.42.5(pid=15437): stderr: | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024718467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:19.936179 run osmo-stp_10.42.42.5(pid=15437): stdout: | (launched: 2022-12-10_02:47:18.295162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:20.061596 run osmo-stp_10.42.42.5(pid=15437): stderr: | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024718466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024718467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024718467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:20.210790 run patchelf(pid=15440): Terminating (SIGINT) 02:47:20.382537 run patchelf(pid=15440): Terminated: ok {rc=0} 02:47:20.506271 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15437): Process ended prematurely: osmo-stp_10.42.42.5(pid=15437) [trial-2368↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15437)] [trial-2368↪gprs:trx-umtrx↪iperf3m4.py:8] 02:47:20.515684 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:47:20.543612 run osmo-hlr_10.42.42.2(pid=15434): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15434)] 02:47:20.591730 run osmo-hlr_10.42.42.2(pid=15434): stdout: | (launched: 2022-12-10_02:47:17.324933) 02:47:20.641448 run osmo-hlr_10.42.42.2(pid=15434): stderr: | [0;m[1;31m20221210024717502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024717502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024717502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024717503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024717503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024717503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024717515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024717523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024717523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024717523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:20.691244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15423): Terminating (SIGTERM) 02:47:20.730992 run iperf3-srv_10.42.42.10(pid=15424): Terminating (SIGTERM) 02:47:20.770689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15425): Terminating (SIGTERM) 02:47:20.810756 run iperf3-srv_10.42.42.10(pid=15426): Terminating (SIGTERM) 02:47:20.850708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15427): Terminating (SIGTERM) 02:47:20.890708 run iperf3-srv_10.42.42.10(pid=15428): Terminating (SIGTERM) 02:47:20.930478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15429): Terminating (SIGTERM) 02:47:20.970377 run iperf3-srv_10.42.42.10(pid=15430): Terminating (SIGTERM) 02:47:21.010142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15433): Terminating (SIGTERM) 02:47:21.050269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15436): Terminating (SIGTERM) 02:47:21.090046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15439): Terminating (SIGTERM) 02:47:21.130214 --- ParallelTerminationStrategy: PID 15423 died... 02:47:21.149333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15423): Terminated: ok {rc=0} 02:47:21.193733 --- ParallelTerminationStrategy: PID 15424 died... 02:47:21.212444 run iperf3-srv_10.42.42.10(pid=15424): Terminated {rc=256} 02:47:21.256477 --- ParallelTerminationStrategy: PID 15425 died... 02:47:21.275662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15425): Terminated: ok {rc=0} 02:47:21.320042 --- ParallelTerminationStrategy: PID 15426 died... 02:47:21.338804 run iperf3-srv_10.42.42.10(pid=15426): Terminated {rc=256} 02:47:21.382935 --- ParallelTerminationStrategy: PID 15427 died... 02:47:21.401755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15427): Terminated: ok {rc=0} 02:47:21.445934 --- ParallelTerminationStrategy: PID 15428 died... 02:47:21.464525 run iperf3-srv_10.42.42.10(pid=15428): Terminated {rc=256} 02:47:21.508545 --- ParallelTerminationStrategy: PID 15429 died... 02:47:21.527338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15429): Terminated: ok {rc=0} 02:47:21.572181 --- ParallelTerminationStrategy: PID 15430 died... 02:47:21.591020 run iperf3-srv_10.42.42.10(pid=15430): Terminated {rc=256} 02:47:21.635619 --- ParallelTerminationStrategy: PID 15433 died... 02:47:21.654363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15433): Terminated: ok {rc=0} 02:47:21.699211 --- ParallelTerminationStrategy: PID 15436 died... 02:47:21.717944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15436): Terminated: ok {rc=0} 02:47:21.761656 --- ParallelTerminationStrategy: PID 15439 died... 02:47:21.780512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15439): Terminated: ok {rc=0} 02:47:21.863930 bus /gobi_4: Setting Powered False 02:47:22.963172 bus /gobi_4: Setting Powered False 02:47:24.080096 bus /gobi_1: Setting Powered False 02:47:25.178966 bus /gobi_1: Setting Powered False 02:47:26.294903 bus /gobi_0: Setting Powered False 02:47:27.392263 bus /gobi_0: Setting Powered False 02:47:28.510154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx ping.py ---------------------------------------------- 02:47:29.614392 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.625535 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:29.673710 tst ping.py: using LAC 25454 02:47:29.792765 tst ping.py: using RAC 209 02:47:29.910362 tst ping.py: using CellId 25454 02:47:30.027714 tst ping.py: using BVCI 25455 02:47:30.138001 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.148529 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.158987 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.169666 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.180154 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.190756 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.201475 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:30.212232 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:30.328662 tst ping.py:19: start network... 02:47:30.545359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:31.063578 run create_hlr_db(pid=15441): Launched 02:47:31.230790 bus /gobi_6: Setting Powered False 02:47:32.290664 run create_hlr_db(pid=15441): Terminated: ok {rc=0} 02:47:32.742239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Launched 02:47:33.062602 run osmo-hlr_10.42.42.2(pid=15444): Launched 02:47:33.184655 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:33.738074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Launched 02:47:34.057597 run osmo-stp_10.42.42.5(pid=15447): Launched 02:47:34.179893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:34.737815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15449): Launched 02:47:34.861260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:35.132889 run patchelf(pid=15450): Launched 02:47:35.303320 run osmo-stp_10.42.42.5(pid=15447): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] 02:47:35.430639 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-10_02:47:33.999190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:35.559627 run osmo-stp_10.42.42.5(pid=15447): stderr: | [0;m[38;5;43m20221210024734192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024734192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024734193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024734193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:35.689247 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-10_02:47:33.999190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:35.812436 run osmo-stp_10.42.42.5(pid=15447): stderr: | [0;m[38;5;43m20221210024734192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024734192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024734193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024734193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024734194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:35.965579 run patchelf(pid=15450): Terminating (SIGINT) 02:47:36.145818 run patchelf(pid=15450): Terminated: ok {rc=0} 02:47:36.276222 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2368↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] [trial-2368↪gprs:trx-umtrx↪ping.py:22] 02:47:36.285630 tst ping.py:22: Test FAILED (6.7 sec) 02:47:36.313760 run osmo-hlr_10.42.42.2(pid=15444): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15444)] 02:47:36.363587 run osmo-hlr_10.42.42.2(pid=15444): stdout: | (launched: 2022-12-10_02:47:33.004369) 02:47:36.414941 run osmo-hlr_10.42.42.2(pid=15444): stderr: | [0;m[1;31m20221210024733203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024733203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024733204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024733204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024733204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024733204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024733220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024733230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024733230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024733230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:36.466766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminating (SIGTERM) 02:47:36.508099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminating (SIGTERM) 02:47:36.549653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15449): Terminating (SIGTERM) 02:47:36.591557 --- ParallelTerminationStrategy: PID 15443 died... 02:47:36.611600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminated: ok {rc=0} 02:47:36.657470 --- ParallelTerminationStrategy: PID 15446 died... 02:47:36.676757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminated: ok {rc=0} 02:47:36.722562 --- ParallelTerminationStrategy: PID 15449 died... 02:47:36.742080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15449): Terminated: ok {rc=0} 02:47:36.829715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 02:47:37.917285 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:37.929519 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:37.981162 tst ping_idle_ping.py: using LAC 25455 02:47:38.108847 tst ping_idle_ping.py: using RAC 210 02:47:38.237201 tst ping_idle_ping.py: using CellId 25455 02:47:38.364923 tst ping_idle_ping.py: using BVCI 25456 02:47:38.482039 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.493186 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.504167 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.515078 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.526023 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.536834 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.547892 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.558859 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:38.674732 tst ping_idle_ping.py:24: start network... 02:47:38.877870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:39.343625 run create_hlr_db(pid=15453): Launched 02:47:39.458562 bus /gobi_6: Setting Powered False 02:47:40.518930 run create_hlr_db(pid=15453): Terminated: ok {rc=0} 02:47:40.961822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Launched 02:47:41.286139 run osmo-hlr_10.42.42.2(pid=15456): Launched 02:47:41.409143 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:41.966755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Launched 02:47:42.289952 run osmo-stp_10.42.42.5(pid=15459): Launched 02:47:42.412691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:42.966455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Launched 02:47:43.090471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:43.363049 run patchelf(pid=15462): Launched 02:47:43.543219 run osmo-stp_10.42.42.5(pid=15459): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] 02:47:43.679904 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-10_02:47:42.231367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:43.818465 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024742423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:43.957985 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-10_02:47:42.231367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:44.090571 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024742423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024742423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024742424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:44.247911 run patchelf(pid=15462): Terminating (SIGINT) 02:47:44.428919 run patchelf(pid=15462): Terminated: ok {rc=0} 02:47:44.558995 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2368↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] [trial-2368↪gprs:trx-umtrx↪ping_idle_ping.py:27] 02:47:44.568325 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:47:44.596379 run osmo-hlr_10.42.42.2(pid=15456): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15456)] 02:47:44.646680 run osmo-hlr_10.42.42.2(pid=15456): stdout: | (launched: 2022-12-10_02:47:41.226927) 02:47:44.699265 run osmo-hlr_10.42.42.2(pid=15456): stderr: | [0;m[1;31m20221210024741425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024741425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024741425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024741425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024741426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024741426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024741438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024741446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024741446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024741446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:44.751845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminating (SIGTERM) 02:47:44.793708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminating (SIGTERM) 02:47:44.835507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Terminating (SIGTERM) 02:47:44.878053 --- ParallelTerminationStrategy: PID 15455 died... 02:47:44.898312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminated: ok {rc=0} 02:47:44.945065 --- ParallelTerminationStrategy: PID 15458 died... 02:47:44.964830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminated: ok {rc=0} 02:47:45.011411 --- ParallelTerminationStrategy: PID 15461 died... 02:47:45.031242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Terminated: ok {rc=0} 02:47:45.119921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 02:47:46.429839 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:47:46.439319 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:47:46.482533 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:47:46.523573 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:47:46.621517 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:47:46.655937 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:47:46.697729 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:47:47.283224 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:47:47.334827 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.345847 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:47:47.401226 tst cs_paging_gprs_active.py: using LAC 25456 02:47:47.523410 tst cs_paging_gprs_active.py: using RAC 211 02:47:47.652425 tst cs_paging_gprs_active.py: using CellId 25456 02:47:47.779690 tst cs_paging_gprs_active.py: using BVCI 25457 02:47:47.901787 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.913265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.924225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.935552 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.946759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.957832 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.969297 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.980358 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:47.991694 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:47:48.109331 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:47:48.230032 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:47:48.453058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:48.782969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15466): Launched 02:47:49.069854 run iperf3-srv_10.42.42.10(pid=15467): Launched 02:47:49.193948 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:47:49.415117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:49.743963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15468): Launched 02:47:50.029191 run iperf3-srv_10.42.42.10(pid=15469): Launched 02:47:50.146453 tst cs_paging_gprs_active.py:38: start network... 02:47:50.352031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:50.827265 run create_hlr_db(pid=15470): Launched 02:47:50.946436 bus /gobi_6: Setting Powered False 02:47:52.005397 run create_hlr_db(pid=15470): Terminated: ok {rc=0} 02:47:52.431616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15472): Launched 02:47:52.739952 run osmo-hlr_10.42.42.2(pid=15473): Launched 02:47:52.858225 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:53.386945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15475): Launched 02:47:53.693603 run osmo-stp_10.42.42.5(pid=15476): Launched 02:47:53.812549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:54.354583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15478): Launched 02:47:54.471655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:54.728867 run patchelf(pid=15479): Launched 02:47:54.899300 run osmo-stp_10.42.42.5(pid=15476): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15476)] 02:47:55.028400 run osmo-stp_10.42.42.5(pid=15476): stdout: | (launched: 2022-12-10_02:47:53.637597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:55.158975 run osmo-stp_10.42.42.5(pid=15476): stderr: | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024753811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:55.289927 run osmo-stp_10.42.42.5(pid=15476): stdout: | (launched: 2022-12-10_02:47:53.637597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:55.415189 run osmo-stp_10.42.42.5(pid=15476): stderr: | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024753810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024753811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024753811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:55.563451 run patchelf(pid=15479): Terminating (SIGINT) 02:47:55.734767 run patchelf(pid=15479): Terminated: ok {rc=0} 02:47:55.858400 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15476): Process ended prematurely: osmo-stp_10.42.42.5(pid=15476) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15476)] [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:47:55.867771 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:47:55.895656 run osmo-hlr_10.42.42.2(pid=15473): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15473)] 02:47:55.949185 run osmo-hlr_10.42.42.2(pid=15473): stdout: | (launched: 2022-12-10_02:47:52.683098) 02:47:56.001400 run osmo-hlr_10.42.42.2(pid=15473): stderr: | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024752861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024752872 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024752881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024752881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024752881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:56.053976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15466): Terminating (SIGTERM) 02:47:56.095876 run iperf3-srv_10.42.42.10(pid=15467): Terminating (SIGTERM) 02:47:56.137970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15468): Terminating (SIGTERM) 02:47:56.180108 run iperf3-srv_10.42.42.10(pid=15469): Terminating (SIGTERM) 02:47:56.222447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15472): Terminating (SIGTERM) 02:47:56.264820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15475): Terminating (SIGTERM) 02:47:56.306762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15478): Terminating (SIGTERM) 02:47:56.349225 --- ParallelTerminationStrategy: PID 15466 died... 02:47:56.368896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15466): Terminated: ok {rc=0} 02:47:56.415873 --- ParallelTerminationStrategy: PID 15467 died... 02:47:56.435330 run iperf3-srv_10.42.42.10(pid=15467): Terminated {rc=256} 02:47:56.482388 --- ParallelTerminationStrategy: PID 15468 died... 02:47:56.501981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15468): Terminated: ok {rc=0} 02:47:56.549274 --- ParallelTerminationStrategy: PID 15469 died... 02:47:56.568770 run iperf3-srv_10.42.42.10(pid=15469): Terminated {rc=256} 02:47:56.615979 --- ParallelTerminationStrategy: PID 15472 died... 02:47:56.635672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15472): Terminated: ok {rc=0} 02:47:56.682522 --- ParallelTerminationStrategy: PID 15475 died... 02:47:56.702207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15475): Terminated: ok {rc=0} 02:47:56.749647 --- ParallelTerminationStrategy: PID 15478 died... 02:47:56.769584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15478): Terminated: ok {rc=0} 02:47:56.858257 bus /gobi_0: Setting Powered False 02:47:57.956741 bus /gobi_0: Setting Powered False 02:47:59.072432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:48:00.222236 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.234404 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:00.290033 tst iperf3.py: using LAC 25457 02:48:00.412742 tst iperf3.py: using RAC 212 02:48:00.535565 tst iperf3.py: using CellId 25457 02:48:00.666724 tst iperf3.py: using BVCI 25458 02:48:00.786674 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.798407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.809649 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.821905 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.843258 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.861847 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.874139 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.889108 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:00.902050 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:01.021953 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:01.238302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:01.559026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15480): Launched 02:48:01.853877 run iperf3-srv_10.42.42.10(pid=15481): Launched 02:48:01.982066 tst iperf3.py:8: start network... 02:48:02.193325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:02.667511 run create_hlr_db(pid=15482): Launched 02:48:02.784595 bus /gobi_6: Setting Powered False 02:48:03.845823 run create_hlr_db(pid=15482): Terminated: ok {rc=0} 02:48:04.290408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Launched 02:48:04.600797 run osmo-hlr_10.42.42.2(pid=15485): Launched 02:48:04.717093 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:05.246553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Launched 02:48:05.573704 run osmo-stp_10.42.42.5(pid=15488): Launched 02:48:05.699634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:06.265155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15490): Launched 02:48:06.389715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:06.664075 run patchelf(pid=15491): Launched 02:48:06.846168 run osmo-stp_10.42.42.5(pid=15488): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] 02:48:06.983818 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-10_02:48:05.514423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:07.122901 run osmo-stp_10.42.42.5(pid=15488): stderr: | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024805706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:07.262278 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-10_02:48:05.514423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:07.396124 run osmo-stp_10.42.42.5(pid=15488): stderr: | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024805706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024805706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024805707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:07.554224 run patchelf(pid=15491): Terminating (SIGINT) 02:48:07.736937 run patchelf(pid=15491): Terminated: ok {rc=0} 02:48:07.868638 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 02:48:07.878667 tst iperf3.py:8: Test FAILED (7.7 sec) 02:48:07.906842 run osmo-hlr_10.42.42.2(pid=15485): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15485)] 02:48:07.956393 run osmo-hlr_10.42.42.2(pid=15485): stdout: | (launched: 2022-12-10_02:48:04.544467) 02:48:08.007704 run osmo-hlr_10.42.42.2(pid=15485): stderr: | [0;m[1;31m20221210024804722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024804723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024804723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024804723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024804723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024804723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024804736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024804745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024804745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024804745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:08.059397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15480): Terminating (SIGTERM) 02:48:08.100723 run iperf3-srv_10.42.42.10(pid=15481): Terminating (SIGTERM) 02:48:08.142480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminating (SIGTERM) 02:48:08.183930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminating (SIGTERM) 02:48:08.225367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15490): Terminating (SIGTERM) 02:48:08.267034 --- ParallelTerminationStrategy: PID 15480 died... 02:48:08.287189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15480): Terminated: ok {rc=0} 02:48:08.333615 --- ParallelTerminationStrategy: PID 15481 died... 02:48:08.353410 run iperf3-srv_10.42.42.10(pid=15481): Terminated {rc=256} 02:48:08.399602 --- ParallelTerminationStrategy: PID 15484 died... 02:48:08.419178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminated: ok {rc=0} 02:48:08.464807 --- ParallelTerminationStrategy: PID 15487 died... 02:48:08.484656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminated: ok {rc=0} 02:48:08.530943 --- ParallelTerminationStrategy: PID 15490 died... 02:48:08.550692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15490): Terminated: ok {rc=0} 02:48:08.638915 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:48:09.790635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.802625 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:09.854021 tst iperf3m4.py: using LAC 25458 02:48:09.983733 tst iperf3m4.py: using RAC 213 02:48:10.111568 tst iperf3m4.py: using CellId 25458 02:48:10.241654 tst iperf3m4.py: using BVCI 25459 02:48:10.362152 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.373507 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.384527 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.395628 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.406788 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.417795 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.429028 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.439978 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:10.451245 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:10.571250 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:10.690343 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:10.809378 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:10.928779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:11.133970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:11.440753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15492): Launched 02:48:11.707496 run iperf3-srv_10.42.42.10(pid=15493): Launched 02:48:11.823315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:48:12.028169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:12.334696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15494): Launched 02:48:12.600420 run iperf3-srv_10.42.42.10(pid=15495): Launched 02:48:12.716162 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:48:12.921107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:13.227433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Launched 02:48:13.493686 run iperf3-srv_10.42.42.10(pid=15497): Launched 02:48:13.609823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:48:13.815384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:14.122790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15498): Launched 02:48:14.388888 run iperf3-srv_10.42.42.10(pid=15499): Launched 02:48:14.504425 tst iperf3m4.py:8: start network... 02:48:14.708701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:15.182029 run create_hlr_db(pid=15500): Launched 02:48:15.300473 bus /gobi_6: Setting Powered False 02:48:16.376685 run create_hlr_db(pid=15500): Terminated: ok {rc=0} 02:48:16.899040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Launched 02:48:17.241455 run osmo-hlr_10.42.42.2(pid=15503): Launched 02:48:17.370076 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:17.938330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Launched 02:48:18.267222 run osmo-stp_10.42.42.5(pid=15506): Launched 02:48:18.393864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:18.961507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Launched 02:48:19.087658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:19.366181 run patchelf(pid=15509): Launched 02:48:19.549488 run osmo-stp_10.42.42.5(pid=15506): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] 02:48:19.687793 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-10_02:48:18.206932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:19.827843 run osmo-stp_10.42.42.5(pid=15506): stderr: | [0;m[38;5;43m20221210024818400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024818400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024818401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024818401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024818401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024818401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024818402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:19.967756 run osmo-stp_10.42.42.5(pid=15506): stdout: | (launched: 2022-12-10_02:48:18.206932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:20.103219 run osmo-stp_10.42.42.5(pid=15506): stderr: | [0;m[38;5;43m20221210024818400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024818400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024818401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024818401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024818401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024818401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024818402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:20.263092 run patchelf(pid=15509): Terminating (SIGINT) 02:48:20.447656 run patchelf(pid=15509): Terminated: ok {rc=0} 02:48:20.580304 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 02:48:20.590580 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:48:20.619327 run osmo-hlr_10.42.42.2(pid=15503): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15503)] 02:48:20.669552 run osmo-hlr_10.42.42.2(pid=15503): stdout: | (launched: 2022-12-10_02:48:17.182019) 02:48:20.721409 run osmo-hlr_10.42.42.2(pid=15503): stderr: | [0;m[1;31m20221210024817380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024817380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024817380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024817380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024817381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024817381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024817393 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024817402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024817402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024817402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:20.773805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15492): Terminating (SIGTERM) 02:48:20.815600 run iperf3-srv_10.42.42.10(pid=15493): Terminating (SIGTERM) 02:48:20.858545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15494): Terminating (SIGTERM) 02:48:20.900748 run iperf3-srv_10.42.42.10(pid=15495): Terminating (SIGTERM) 02:48:20.942824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Terminating (SIGTERM) 02:48:20.985040 run iperf3-srv_10.42.42.10(pid=15497): Terminating (SIGTERM) 02:48:21.026707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15498): Terminating (SIGTERM) 02:48:21.068612 run iperf3-srv_10.42.42.10(pid=15499): Terminating (SIGTERM) 02:48:21.110422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminating (SIGTERM) 02:48:21.152233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminating (SIGTERM) 02:48:21.194008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Terminating (SIGTERM) 02:48:21.236336 --- ParallelTerminationStrategy: PID 15492 died... 02:48:21.256655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15492): Terminated: ok {rc=0} 02:48:21.303404 --- ParallelTerminationStrategy: PID 15493 died... 02:48:21.323166 run iperf3-srv_10.42.42.10(pid=15493): Terminated {rc=256} 02:48:21.369666 --- ParallelTerminationStrategy: PID 15494 died... 02:48:21.389466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15494): Terminated: ok {rc=0} 02:48:21.435623 --- ParallelTerminationStrategy: PID 15495 died... 02:48:21.455216 run iperf3-srv_10.42.42.10(pid=15495): Terminated {rc=256} 02:48:21.501064 --- ParallelTerminationStrategy: PID 15496 died... 02:48:21.520544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Terminated: ok {rc=0} 02:48:21.566591 --- ParallelTerminationStrategy: PID 15497 died... 02:48:21.586278 run iperf3-srv_10.42.42.10(pid=15497): Terminated {rc=256} 02:48:21.632160 --- ParallelTerminationStrategy: PID 15498 died... 02:48:21.651915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15498): Terminated: ok {rc=0} 02:48:21.698523 --- ParallelTerminationStrategy: PID 15499 died... 02:48:21.718272 run iperf3-srv_10.42.42.10(pid=15499): Terminated {rc=256} 02:48:21.764170 --- ParallelTerminationStrategy: PID 15502 died... 02:48:21.783655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15502): Terminated: ok {rc=0} 02:48:21.829890 --- ParallelTerminationStrategy: PID 15505 died... 02:48:21.849633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15505): Terminated: ok {rc=0} 02:48:21.895540 --- ParallelTerminationStrategy: PID 15508 died... 02:48:21.915231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15508): Terminated: ok {rc=0} 02:48:22.002828 bus /gobi_4: Setting Powered False 02:48:23.103159 bus /gobi_4: Setting Powered False 02:48:24.219098 bus /gobi_1: Setting Powered False 02:48:25.317961 bus /gobi_1: Setting Powered False 02:48:26.436239 bus /gobi_0: Setting Powered False 02:48:27.534363 bus /gobi_0: Setting Powered False 02:48:28.651043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 02:48:29.754007 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:29.765491 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:29.818211 tst ping.py: using LAC 25459 02:48:29.935837 tst ping.py: using RAC 214 02:48:30.051776 tst ping.py: using CellId 25459 02:48:30.167507 tst ping.py: using BVCI 25460 02:48:30.276510 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.287448 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.298168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.309058 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.320236 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.331008 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.342023 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.353002 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:30.470561 tst ping.py:19: start network... 02:48:30.670523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:31.169044 run create_hlr_db(pid=15510): Launched 02:48:31.341840 bus /gobi_6: Setting Powered False 02:48:32.401510 run create_hlr_db(pid=15510): Terminated: ok {rc=0} 02:48:32.842031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Launched 02:48:33.163822 run osmo-hlr_10.42.42.2(pid=15513): Launched 02:48:33.286939 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:33.842405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Launched 02:48:34.162423 run osmo-stp_10.42.42.5(pid=15516): Launched 02:48:34.284536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:34.835957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15518): Launched 02:48:34.959307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:35.231746 run patchelf(pid=15519): Launched 02:48:35.411518 run osmo-stp_10.42.42.5(pid=15516): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] 02:48:35.547580 run osmo-stp_10.42.42.5(pid=15516): stdout: | (launched: 2022-12-10_02:48:34.104121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:35.685192 run osmo-stp_10.42.42.5(pid=15516): stderr: | [0;m[38;5;43m20221210024834296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024834296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024834297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024834297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024834297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024834298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024834298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:35.822672 run osmo-stp_10.42.42.5(pid=15516): stdout: | (launched: 2022-12-10_02:48:34.104121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:35.954623 run osmo-stp_10.42.42.5(pid=15516): stderr: | [0;m[38;5;43m20221210024834296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024834296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024834297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024834297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024834297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024834298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024834298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:36.110555 run patchelf(pid=15519): Terminating (SIGINT) 02:48:36.290943 run patchelf(pid=15519): Terminated: ok {rc=0} 02:48:36.420256 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15516): Process ended prematurely: osmo-stp_10.42.42.5(pid=15516) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 02:48:36.429608 tst ping.py:22: Test FAILED (6.7 sec) 02:48:36.457712 run osmo-hlr_10.42.42.2(pid=15513): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15513)] 02:48:36.507808 run osmo-hlr_10.42.42.2(pid=15513): stdout: | (launched: 2022-12-10_02:48:33.105418) 02:48:36.559582 run osmo-hlr_10.42.42.2(pid=15513): stderr: | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024833302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024833314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024833323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024833323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024833323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:36.611859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Terminating (SIGTERM) 02:48:36.653669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Terminating (SIGTERM) 02:48:36.695756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15518): Terminating (SIGTERM) 02:48:36.738140 --- ParallelTerminationStrategy: PID 15512 died... 02:48:36.758328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Terminated: ok {rc=0} 02:48:36.804859 --- ParallelTerminationStrategy: PID 15515 died... 02:48:36.824732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Terminated: ok {rc=0} 02:48:36.870897 --- ParallelTerminationStrategy: PID 15518 died... 02:48:36.890616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15518): Terminated: ok {rc=0} 02:48:36.978008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:48:38.067155 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.079765 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:38.132639 tst ping_idle_ping.py: using LAC 25460 02:48:38.261040 tst ping_idle_ping.py: using RAC 215 02:48:38.388099 tst ping_idle_ping.py: using CellId 25460 02:48:38.513454 tst ping_idle_ping.py: using BVCI 25461 02:48:38.624621 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.635803 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.646727 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.658436 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.669947 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.681446 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.693271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.704619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:38.824194 tst ping_idle_ping.py:24: start network... 02:48:39.042811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:39.545718 run create_hlr_db(pid=15520): Launched 02:48:39.678389 bus /gobi_6: Setting Powered False 02:48:40.742434 run create_hlr_db(pid=15520): Terminated: ok {rc=0} 02:48:41.174970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15522): Launched 02:48:41.477293 run osmo-hlr_10.42.42.2(pid=15523): Launched 02:48:41.593905 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:42.152776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15525): Launched 02:48:42.475933 run osmo-stp_10.42.42.5(pid=15526): Launched 02:48:42.598712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:43.154180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15528): Launched 02:48:43.278551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:43.551264 run patchelf(pid=15529): Launched 02:48:43.731763 run osmo-stp_10.42.42.5(pid=15526): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] 02:48:43.868860 run osmo-stp_10.42.42.5(pid=15526): stdout: | (launched: 2022-12-10_02:48:42.417259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:44.007111 run osmo-stp_10.42.42.5(pid=15526): stderr: | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024842615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:44.145618 run osmo-stp_10.42.42.5(pid=15526): stdout: | (launched: 2022-12-10_02:48:42.417259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:44.278490 run osmo-stp_10.42.42.5(pid=15526): stderr: | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024842614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024842615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024842615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:44.435754 run patchelf(pid=15529): Terminating (SIGINT) 02:48:44.617160 run patchelf(pid=15529): Terminated: ok {rc=0} 02:48:44.747660 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15526): Process ended prematurely: osmo-stp_10.42.42.5(pid=15526) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 02:48:44.757127 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:48:44.785217 run osmo-hlr_10.42.42.2(pid=15523): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15523)] 02:48:44.835550 run osmo-hlr_10.42.42.2(pid=15523): stdout: | (launched: 2022-12-10_02:48:41.421861) 02:48:44.887994 run osmo-hlr_10.42.42.2(pid=15523): stderr: | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024841599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024841612 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024841621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024841621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024841621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:44.940610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15522): Terminating (SIGTERM) 02:48:44.982716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15525): Terminating (SIGTERM) 02:48:45.025034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15528): Terminating (SIGTERM) 02:48:45.067835 --- ParallelTerminationStrategy: PID 15522 died... 02:48:45.088253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15522): Terminated: ok {rc=0} 02:48:45.135216 --- ParallelTerminationStrategy: PID 15525 died... 02:48:45.155450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15525): Terminated: ok {rc=0} 02:48:45.202024 --- ParallelTerminationStrategy: PID 15528 died... 02:48:45.222073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15528): Terminated: ok {rc=0} 02:48:45.310804 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:48:46.680922 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:48:46.690105 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:48:46.731969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:48:46.780904 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:48:46.872840 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:48:46.915748 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:48:46.967182 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:48:47.536872 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:48:47.588340 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:47.599279 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:48:47.667685 tst cs_paging_gprs_active.py: using LAC 25461 02:48:47.797302 tst cs_paging_gprs_active.py: using RAC 216 02:48:47.926423 tst cs_paging_gprs_active.py: using CellId 25461 02:48:48.053609 tst cs_paging_gprs_active.py: using BVCI 25462 02:48:48.173593 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.184858 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.196631 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.208501 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.219818 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.231183 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.242830 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.254265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:48.265624 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:48:48.385473 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:48:48.502421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:48:48.709083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:49.016766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Launched 02:48:49.284710 run iperf3-srv_10.42.42.10(pid=15534): Launched 02:48:49.400759 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:48:49.604686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:49.911363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Launched 02:48:50.178911 run iperf3-srv_10.42.42.10(pid=15536): Launched 02:48:50.293956 tst cs_paging_gprs_active.py:38: start network... 02:48:50.497935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:50.970161 run create_hlr_db(pid=15537): Launched 02:48:51.088724 bus /gobi_6: Setting Powered False 02:48:52.150270 run create_hlr_db(pid=15537): Terminated: ok {rc=0} 02:48:52.575390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Launched 02:48:52.883019 run osmo-hlr_10.42.42.2(pid=15540): Launched 02:48:53.000497 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:53.526020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Launched 02:48:53.832732 run osmo-stp_10.42.42.5(pid=15543): Launched 02:48:53.950522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:54.492841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Launched 02:48:54.610875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:54.877393 run patchelf(pid=15546): Launched 02:48:55.048895 run osmo-stp_10.42.42.5(pid=15543): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] 02:48:55.178849 run osmo-stp_10.42.42.5(pid=15543): stdout: | (launched: 2022-12-10_02:48:53.776517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:55.310688 run osmo-stp_10.42.42.5(pid=15543): stderr: | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024853952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:55.442237 run osmo-stp_10.42.42.5(pid=15543): stdout: | (launched: 2022-12-10_02:48:53.776517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:55.568270 run osmo-stp_10.42.42.5(pid=15543): stderr: | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024853951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024853952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024853952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:55.718293 run patchelf(pid=15546): Terminating (SIGINT) 02:48:55.890810 run patchelf(pid=15546): Terminated: ok {rc=0} 02:48:56.015256 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15543): Process ended prematurely: osmo-stp_10.42.42.5(pid=15543) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:48:56.024995 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:48:56.052746 run osmo-hlr_10.42.42.2(pid=15540): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15540)] 02:48:56.100499 run osmo-hlr_10.42.42.2(pid=15540): stdout: | (launched: 2022-12-10_02:48:52.826585) 02:48:56.149677 run osmo-hlr_10.42.42.2(pid=15540): stderr: | [0;m[1;31m20221210024853004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024853004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024853004 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024853005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024853005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024853005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024853017 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024853025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024853025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024853025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:56.199611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminating (SIGTERM) 02:48:56.239214 run iperf3-srv_10.42.42.10(pid=15534): Terminating (SIGTERM) 02:48:56.278671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Terminating (SIGTERM) 02:48:56.318414 run iperf3-srv_10.42.42.10(pid=15536): Terminating (SIGTERM) 02:48:56.358064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Terminating (SIGTERM) 02:48:56.397782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Terminating (SIGTERM) 02:48:56.437668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Terminating (SIGTERM) 02:48:56.477714 --- ParallelTerminationStrategy: PID 15533 died... 02:48:56.496801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminated: ok {rc=0} 02:48:56.541166 --- ParallelTerminationStrategy: PID 15534 died... 02:48:56.559766 run iperf3-srv_10.42.42.10(pid=15534): Terminated {rc=256} 02:48:56.603700 --- ParallelTerminationStrategy: PID 15535 died... 02:48:56.622380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15535): Terminated: ok {rc=0} 02:48:56.666281 --- ParallelTerminationStrategy: PID 15536 died... 02:48:56.684727 run iperf3-srv_10.42.42.10(pid=15536): Terminated {rc=256} 02:48:56.728833 --- ParallelTerminationStrategy: PID 15539 died... 02:48:56.747880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Terminated: ok {rc=0} 02:48:56.792085 --- ParallelTerminationStrategy: PID 15542 died... 02:48:56.810887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Terminated: ok {rc=0} 02:48:56.855047 --- ParallelTerminationStrategy: PID 15545 died... 02:48:56.873792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Terminated: ok {rc=0} 02:48:56.957374 bus /gobi_0: Setting Powered False 02:48:58.056760 bus /gobi_0: Setting Powered False 02:48:59.174397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:49:00.321336 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:00.332738 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:00.401928 tst iperf3.py: using LAC 25462 02:49:00.532300 tst iperf3.py: using RAC 217 02:49:00.661278 tst iperf3.py: using CellId 25462 02:49:00.789599 tst iperf3.py: using BVCI 25463 02:49:00.938522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:00.950601 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:00.962549 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:00.975171 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:00.988982 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:01.000593 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:01.014345 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:01.026270 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:01.038158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:01.182666 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:01.449633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:01.778776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Launched 02:49:02.067203 run iperf3-srv_10.42.42.10(pid=15549): Launched 02:49:02.198151 tst iperf3.py:8: start network... 02:49:02.403545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:02.877402 run create_hlr_db(pid=15550): Launched 02:49:02.995183 bus /gobi_6: Setting Powered False 02:49:04.056128 run create_hlr_db(pid=15550): Terminated: ok {rc=0} 02:49:04.502060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Launched 02:49:04.829777 run osmo-hlr_10.42.42.2(pid=15553): Launched 02:49:04.954986 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:05.616063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Launched 02:49:05.935024 run osmo-stp_10.42.42.5(pid=15556): Launched 02:49:06.057128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:06.610801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Launched 02:49:06.733607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:07.003221 run patchelf(pid=15559): Launched 02:49:07.181105 run osmo-stp_10.42.42.5(pid=15556): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] 02:49:07.316824 run osmo-stp_10.42.42.5(pid=15556): stdout: | (launched: 2022-12-10_02:49:05.876844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:07.453393 run osmo-stp_10.42.42.5(pid=15556): stderr: | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024906069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:07.585378 run osmo-stp_10.42.42.5(pid=15556): stdout: | (launched: 2022-12-10_02:49:05.876844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:07.708870 run osmo-stp_10.42.42.5(pid=15556): stderr: | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024906068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024906069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024906069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:07.855555 run patchelf(pid=15559): Terminating (SIGINT) 02:49:08.024363 run patchelf(pid=15559): Terminated: ok {rc=0} 02:49:08.146174 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15556): Process ended prematurely: osmo-stp_10.42.42.5(pid=15556) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 02:49:08.155692 tst iperf3.py:8: Test FAILED (7.9 sec) 02:49:08.182964 run osmo-hlr_10.42.42.2(pid=15553): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15553)] 02:49:08.230828 run osmo-hlr_10.42.42.2(pid=15553): stdout: | (launched: 2022-12-10_02:49:04.770201) 02:49:08.280243 run osmo-hlr_10.42.42.2(pid=15553): stderr: | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024904971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024904984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024904992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024904992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024904992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:08.329864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Terminating (SIGTERM) 02:49:08.369719 run iperf3-srv_10.42.42.10(pid=15549): Terminating (SIGTERM) 02:49:08.409468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Terminating (SIGTERM) 02:49:08.449573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Terminating (SIGTERM) 02:49:08.489374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Terminating (SIGTERM) 02:49:08.529756 --- ParallelTerminationStrategy: PID 15548 died... 02:49:08.548733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15548): Terminated: ok {rc=0} 02:49:08.593865 --- ParallelTerminationStrategy: PID 15549 died... 02:49:08.612360 run iperf3-srv_10.42.42.10(pid=15549): Terminated {rc=256} 02:49:08.656760 --- ParallelTerminationStrategy: PID 15552 died... 02:49:08.675580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15552): Terminated: ok {rc=0} 02:49:08.719800 --- ParallelTerminationStrategy: PID 15555 died... 02:49:08.738449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15555): Terminated: ok {rc=0} 02:49:08.782680 --- ParallelTerminationStrategy: PID 15558 died... 02:49:08.801342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15558): Terminated: ok {rc=0} 02:49:08.886201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:49:10.037557 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.049666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:10.125958 tst iperf3m4.py: using LAC 25463 02:49:10.251043 tst iperf3m4.py: using RAC 218 02:49:10.374354 tst iperf3m4.py: using CellId 25463 02:49:10.498130 tst iperf3m4.py: using BVCI 25464 02:49:10.614909 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.626297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.637620 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.649495 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.661210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.672817 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.684581 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.696284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:10.708353 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:10.828733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:10.953091 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:11.074512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:11.191734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:11.393927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:11.695217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15560): Launched 02:49:11.956673 run iperf3-srv_10.42.42.10(pid=15561): Launched 02:49:12.070246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:49:12.270909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:12.571664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15562): Launched 02:49:12.833477 run iperf3-srv_10.42.42.10(pid=15563): Launched 02:49:12.947603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:49:13.149174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:13.452184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Launched 02:49:13.714227 run iperf3-srv_10.42.42.10(pid=15565): Launched 02:49:13.827828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:49:14.029053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:14.330693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15566): Launched 02:49:14.592429 run iperf3-srv_10.42.42.10(pid=15567): Launched 02:49:14.705895 tst iperf3m4.py:8: start network... 02:49:14.906233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:15.375065 run create_hlr_db(pid=15568): Launched 02:49:15.492545 bus /gobi_6: Setting Powered False 02:49:16.556030 run create_hlr_db(pid=15568): Terminated: ok {rc=0} 02:49:17.020099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15570): Launched 02:49:17.355660 run osmo-hlr_10.42.42.2(pid=15571): Launched 02:49:17.480324 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:18.036023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15573): Launched 02:49:18.357175 run osmo-stp_10.42.42.5(pid=15574): Launched 02:49:18.479355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:19.032312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15576): Launched 02:49:19.155242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:19.427951 run patchelf(pid=15577): Launched 02:49:19.607127 run osmo-stp_10.42.42.5(pid=15574): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15574)] 02:49:19.742918 run osmo-stp_10.42.42.5(pid=15574): stdout: | (launched: 2022-12-10_02:49:18.298408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:19.879936 run osmo-stp_10.42.42.5(pid=15574): stderr: | [0;m[38;5;43m20221210024918491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024918491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024918492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024918492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024918492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024918493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024918493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:20.017306 run osmo-stp_10.42.42.5(pid=15574): stdout: | (launched: 2022-12-10_02:49:18.298408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:20.149468 run osmo-stp_10.42.42.5(pid=15574): stderr: | [0;m[38;5;43m20221210024918491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024918491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024918492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024918492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024918492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024918493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024918493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:20.306390 run patchelf(pid=15577): Terminating (SIGINT) 02:49:20.486527 run patchelf(pid=15577): Terminated: ok {rc=0} 02:49:20.616207 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15574): Process ended prematurely: osmo-stp_10.42.42.5(pid=15574) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15574)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:49:20.626299 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:49:20.654771 run osmo-hlr_10.42.42.2(pid=15571): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15571)] 02:49:20.704801 run osmo-hlr_10.42.42.2(pid=15571): stdout: | (launched: 2022-12-10_02:49:17.296833) 02:49:20.756562 run osmo-hlr_10.42.42.2(pid=15571): stderr: | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024917492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024917504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024917515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024917515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024917515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:20.809206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15560): Terminating (SIGTERM) 02:49:20.850996 run iperf3-srv_10.42.42.10(pid=15561): Terminating (SIGTERM) 02:49:20.892807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15562): Terminating (SIGTERM) 02:49:20.934215 run iperf3-srv_10.42.42.10(pid=15563): Terminating (SIGTERM) 02:49:20.975391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Terminating (SIGTERM) 02:49:21.016826 run iperf3-srv_10.42.42.10(pid=15565): Terminating (SIGTERM) 02:49:21.058257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15566): Terminating (SIGTERM) 02:49:21.099595 run iperf3-srv_10.42.42.10(pid=15567): Terminating (SIGTERM) 02:49:21.140645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15570): Terminating (SIGTERM) 02:49:21.182217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15573): Terminating (SIGTERM) 02:49:21.223916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15576): Terminating (SIGTERM) 02:49:21.265931 --- ParallelTerminationStrategy: PID 15560 died... 02:49:21.285760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15560): Terminated: ok {rc=0} 02:49:21.331625 --- ParallelTerminationStrategy: PID 15561 died... 02:49:21.351002 run iperf3-srv_10.42.42.10(pid=15561): Terminated {rc=256} 02:49:21.396358 --- ParallelTerminationStrategy: PID 15562 died... 02:49:21.415689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15562): Terminated: ok {rc=0} 02:49:21.461800 --- ParallelTerminationStrategy: PID 15563 died... 02:49:21.481135 run iperf3-srv_10.42.42.10(pid=15563): Terminated {rc=256} 02:49:21.526570 --- ParallelTerminationStrategy: PID 15564 died... 02:49:21.545879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Terminated: ok {rc=0} 02:49:21.591596 --- ParallelTerminationStrategy: PID 15565 died... 02:49:21.610925 run iperf3-srv_10.42.42.10(pid=15565): Terminated {rc=256} 02:49:21.656364 --- ParallelTerminationStrategy: PID 15566 died... 02:49:21.675827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15566): Terminated: ok {rc=0} 02:49:21.721597 --- ParallelTerminationStrategy: PID 15567 died... 02:49:21.740871 run iperf3-srv_10.42.42.10(pid=15567): Terminated {rc=256} 02:49:21.786300 --- ParallelTerminationStrategy: PID 15570 died... 02:49:21.805627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15570): Terminated: ok {rc=0} 02:49:21.851234 --- ParallelTerminationStrategy: PID 15573 died... 02:49:21.870617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15573): Terminated: ok {rc=0} 02:49:21.916744 --- ParallelTerminationStrategy: PID 15576 died... 02:49:21.936259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15576): Terminated: ok {rc=0} 02:49:22.022928 bus /gobi_4: Setting Powered False 02:49:23.120899 bus /gobi_4: Setting Powered False 02:49:24.238486 bus /gobi_1: Setting Powered False 02:49:25.336514 bus /gobi_1: Setting Powered False 02:49:26.453758 bus /gobi_0: Setting Powered False 02:49:27.552372 bus /gobi_0: Setting Powered False 02:49:28.669795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:49:29.771397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:29.783058 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:29.852544 tst ping.py: using LAC 25464 02:49:29.973281 tst ping.py: using RAC 219 02:49:30.089664 tst ping.py: using CellId 25464 02:49:30.205282 tst ping.py: using BVCI 25465 02:49:30.321864 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.333210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.344263 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.355918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.367470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.379144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.390819 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.402486 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:30.521590 tst ping.py:19: start network... 02:49:30.735362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:31.243179 run create_hlr_db(pid=15578): Launched 02:49:31.400634 bus /gobi_6: Setting Powered False 02:49:32.462964 run create_hlr_db(pid=15578): Terminated: ok {rc=0} 02:49:32.887602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15580): Launched 02:49:33.182989 run osmo-hlr_10.42.42.2(pid=15581): Launched 02:49:33.295817 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:33.821490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15583): Launched 02:49:34.118963 run osmo-stp_10.42.42.5(pid=15584): Launched 02:49:34.231409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:34.742195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15586): Launched 02:49:34.855860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:35.105056 run patchelf(pid=15587): Launched 02:49:35.270647 run osmo-stp_10.42.42.5(pid=15584): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15584)] 02:49:35.396552 run osmo-stp_10.42.42.5(pid=15584): stdout: | (launched: 2022-12-10_02:49:34.064499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:35.523834 run osmo-stp_10.42.42.5(pid=15584): stderr: | [0;m[38;5;43m20221210024934235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024934236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024934236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024934236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:35.651769 run osmo-stp_10.42.42.5(pid=15584): stdout: | (launched: 2022-12-10_02:49:34.064499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:35.773334 run osmo-stp_10.42.42.5(pid=15584): stderr: | [0;m[38;5;43m20221210024934235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024934236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024934236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024934236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024934237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:35.917820 run patchelf(pid=15587): Terminating (SIGINT) 02:49:36.084031 run patchelf(pid=15587): Terminated: ok {rc=0} 02:49:36.203980 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15584): Process ended prematurely: osmo-stp_10.42.42.5(pid=15584) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15584)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 02:49:36.212746 tst ping.py:22: Test FAILED (6.4 sec) 02:49:36.239820 run osmo-hlr_10.42.42.2(pid=15581): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15581)] 02:49:36.287617 run osmo-hlr_10.42.42.2(pid=15581): stdout: | (launched: 2022-12-10_02:49:33.129125) 02:49:36.337383 run osmo-hlr_10.42.42.2(pid=15581): stderr: | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024933303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024933315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024933324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024933325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024933325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:36.387675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15580): Terminating (SIGTERM) 02:49:36.427492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15583): Terminating (SIGTERM) 02:49:36.467157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15586): Terminating (SIGTERM) 02:49:36.507052 --- ParallelTerminationStrategy: PID 15580 died... 02:49:36.526156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15580): Terminated: ok {rc=0} 02:49:36.571158 --- ParallelTerminationStrategy: PID 15583 died... 02:49:36.589790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15583): Terminated: ok {rc=0} 02:49:36.634006 --- ParallelTerminationStrategy: PID 15586 died... 02:49:36.652609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15586): Terminated: ok {rc=0} 02:49:36.739165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:49:37.827729 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:37.839705 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:37.910901 tst ping_idle_ping.py: using LAC 25465 02:49:38.026916 tst ping_idle_ping.py: using RAC 220 02:49:38.144255 tst ping_idle_ping.py: using CellId 25465 02:49:38.259737 tst ping_idle_ping.py: using BVCI 25466 02:49:38.366967 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.377896 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.388453 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.399333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.410281 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.421202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.432074 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.442786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:38.559454 tst ping_idle_ping.py:24: start network... 02:49:38.773328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:39.262357 run create_hlr_db(pid=15588): Launched 02:49:39.393322 bus /gobi_6: Setting Powered False 02:49:40.455693 run create_hlr_db(pid=15588): Terminated: ok {rc=0} 02:49:40.879433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15590): Launched 02:49:41.176639 run osmo-hlr_10.42.42.2(pid=15591): Launched 02:49:41.290014 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:41.811694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15593): Launched 02:49:42.110443 run osmo-stp_10.42.42.5(pid=15594): Launched 02:49:42.223320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:42.751809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15596): Launched 02:49:42.867102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:43.118409 run patchelf(pid=15597): Launched 02:49:43.285111 run osmo-stp_10.42.42.5(pid=15594): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15594)] 02:49:43.412210 run osmo-stp_10.42.42.5(pid=15594): stdout: | (launched: 2022-12-10_02:49:42.055821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:43.540535 run osmo-stp_10.42.42.5(pid=15594): stderr: | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024942226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:43.669419 run osmo-stp_10.42.42.5(pid=15594): stdout: | (launched: 2022-12-10_02:49:42.055821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:43.791973 run osmo-stp_10.42.42.5(pid=15594): stderr: | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024942226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024942226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024942227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:43.936858 run patchelf(pid=15597): Terminating (SIGINT) 02:49:44.105531 run patchelf(pid=15597): Terminated: ok {rc=0} 02:49:44.226621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15594): Process ended prematurely: osmo-stp_10.42.42.5(pid=15594) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15594)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:49:44.235476 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:49:44.262550 run osmo-hlr_10.42.42.2(pid=15591): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15591)] 02:49:44.310598 run osmo-hlr_10.42.42.2(pid=15591): stdout: | (launched: 2022-12-10_02:49:41.122450) 02:49:44.360408 run osmo-hlr_10.42.42.2(pid=15591): stderr: | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024941296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024941308 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024941317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024941317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024941317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:44.410400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15590): Terminating (SIGTERM) 02:49:44.450549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15593): Terminating (SIGTERM) 02:49:44.490807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15596): Terminating (SIGTERM) 02:49:44.530923 --- ParallelTerminationStrategy: PID 15590 died... 02:49:44.549956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15590): Terminated: ok {rc=0} 02:49:44.594689 --- ParallelTerminationStrategy: PID 15593 died... 02:49:44.613222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15593): Terminated: ok {rc=0} 02:49:44.657363 --- ParallelTerminationStrategy: PID 15596 died... 02:49:44.675975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15596): Terminated: ok {rc=0} 02:49:44.761312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:49:46.107004 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:49:46.116807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:49:46.158138 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:49:46.199372 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:49:46.290188 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:49:46.333838 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:49:46.383808 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:49:46.963980 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:49:47.019444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.031378 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:49:47.106549 tst cs_paging_gprs_active.py: using LAC 25466 02:49:47.261441 tst cs_paging_gprs_active.py: using RAC 221 02:49:47.390380 tst cs_paging_gprs_active.py: using CellId 25466 02:49:47.518380 tst cs_paging_gprs_active.py: using BVCI 25467 02:49:47.635719 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.647422 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.658658 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.670176 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.681503 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.692837 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.704325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.715652 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:47.726985 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:49:47.844610 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:49:47.964118 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:49:48.168309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:48.472478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Launched 02:49:48.737283 run iperf3-srv_10.42.42.10(pid=15602): Launched 02:49:48.852317 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:49:49.054671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:49.358154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15603): Launched 02:49:49.621395 run iperf3-srv_10.42.42.10(pid=15604): Launched 02:49:49.736265 tst cs_paging_gprs_active.py:38: start network... 02:49:49.939268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:50.409258 run create_hlr_db(pid=15605): Launched 02:49:50.526325 bus /gobi_6: Setting Powered False 02:49:51.586745 run create_hlr_db(pid=15605): Terminated: ok {rc=0} 02:49:52.030317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Launched 02:49:52.354354 run osmo-hlr_10.42.42.2(pid=15608): Launched 02:49:52.480005 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:53.039423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Launched 02:49:53.363304 run osmo-stp_10.42.42.5(pid=15611): Launched 02:49:53.487043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:54.044248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15613): Launched 02:49:54.168486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:54.443480 run patchelf(pid=15614): Launched 02:49:54.623245 run osmo-stp_10.42.42.5(pid=15611): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] 02:49:54.759698 run osmo-stp_10.42.42.5(pid=15611): stdout: | (launched: 2022-12-10_02:49:53.304148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:54.897873 run osmo-stp_10.42.42.5(pid=15611): stderr: | [0;m[38;5;43m20221210024953496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024953497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024953497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024953497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:55.035824 run osmo-stp_10.42.42.5(pid=15611): stdout: | (launched: 2022-12-10_02:49:53.304148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:55.168559 run osmo-stp_10.42.42.5(pid=15611): stderr: | [0;m[38;5;43m20221210024953496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210024953497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210024953497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210024953497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210024953498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:55.326166 run patchelf(pid=15614): Terminating (SIGINT) 02:49:55.507065 run patchelf(pid=15614): Terminated: ok {rc=0} 02:49:55.637835 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15611): Process ended prematurely: osmo-stp_10.42.42.5(pid=15611) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:49:55.647837 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:49:55.676456 run osmo-hlr_10.42.42.2(pid=15608): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15608)] 02:49:55.726777 run osmo-hlr_10.42.42.2(pid=15608): stdout: | (launched: 2022-12-10_02:49:52.295525) 02:49:55.778483 run osmo-hlr_10.42.42.2(pid=15608): stderr: | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210024952492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210024952506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210024952515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210024952515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210024952515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:55.830451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Terminating (SIGTERM) 02:49:55.871978 run iperf3-srv_10.42.42.10(pid=15602): Terminating (SIGTERM) 02:49:55.913775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15603): Terminating (SIGTERM) 02:49:55.955689 run iperf3-srv_10.42.42.10(pid=15604): Terminating (SIGTERM) 02:49:55.997454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Terminating (SIGTERM) 02:49:56.039282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Terminating (SIGTERM) 02:49:56.081231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15613): Terminating (SIGTERM) 02:49:56.123228 --- ParallelTerminationStrategy: PID 15601 died... 02:49:56.143057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15601): Terminated: ok {rc=0} 02:49:56.189371 --- ParallelTerminationStrategy: PID 15602 died... 02:49:56.208686 run iperf3-srv_10.42.42.10(pid=15602): Terminated {rc=256} 02:49:56.254894 --- ParallelTerminationStrategy: PID 15603 died... 02:49:56.274649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15603): Terminated: ok {rc=0} 02:49:56.320770 --- ParallelTerminationStrategy: PID 15604 died... 02:49:56.340453 run iperf3-srv_10.42.42.10(pid=15604): Terminated {rc=256} 02:49:56.386452 --- ParallelTerminationStrategy: PID 15607 died... 02:49:56.406052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15607): Terminated: ok {rc=0} 02:49:56.452262 --- ParallelTerminationStrategy: PID 15610 died... 02:49:56.471852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15610): Terminated: ok {rc=0} 02:49:56.517958 --- ParallelTerminationStrategy: PID 15613 died... 02:49:56.537700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15613): Terminated: ok {rc=0} 02:49:56.625577 bus /gobi_0: Setting Powered False 02:49:57.725936 bus /gobi_0: Setting Powered False 02:49:58.842741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:49:59.987417 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:59.998866 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:00.067736 tst iperf3.py: using LAC 25467 02:50:00.185567 tst iperf3.py: using RAC 222 02:50:00.314441 tst iperf3.py: using CellId 25467 02:50:00.442919 tst iperf3.py: using BVCI 25468 02:50:00.561993 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.573493 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.584818 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.596156 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.607591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.619017 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.630448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.641680 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:00.653095 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:00.768839 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:00.996569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:01.347435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Launched 02:50:01.643465 run iperf3-srv_10.42.42.10(pid=15619): Launched 02:50:01.781547 tst iperf3.py:8: start network... 02:50:02.003251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:02.510628 run create_hlr_db(pid=15620): Launched 02:50:02.642208 bus /gobi_6: Setting Powered False 02:50:03.705307 run create_hlr_db(pid=15620): Terminated: ok {rc=0} 02:50:04.135095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Launched 02:50:04.436853 run osmo-hlr_10.42.42.2(pid=15623): Launched 02:50:04.552014 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:05.085969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Launched 02:50:05.387596 run osmo-stp_10.42.42.5(pid=15626): Launched 02:50:05.503177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:06.022133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Launched 02:50:06.137828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:06.392145 run patchelf(pid=15629): Launched 02:50:06.560503 run osmo-stp_10.42.42.5(pid=15626): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] 02:50:06.687812 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-10_02:50:05.332432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:06.816924 run osmo-stp_10.42.42.5(pid=15626): stderr: | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025005503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:06.945771 run osmo-stp_10.42.42.5(pid=15626): stdout: | (launched: 2022-12-10_02:50:05.332432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:07.069531 run osmo-stp_10.42.42.5(pid=15626): stderr: | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025005503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025005503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025005504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:07.216164 run patchelf(pid=15629): Terminating (SIGINT) 02:50:07.386300 run patchelf(pid=15629): Terminated: ok {rc=0} 02:50:07.508709 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 02:50:07.518231 tst iperf3.py:8: Test FAILED (7.6 sec) 02:50:07.545583 run osmo-hlr_10.42.42.2(pid=15623): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15623)] 02:50:07.593528 run osmo-hlr_10.42.42.2(pid=15623): stdout: | (launched: 2022-12-10_02:50:04.382002) 02:50:07.642853 run osmo-hlr_10.42.42.2(pid=15623): stderr: | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025004556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025004569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025004578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025004578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025004579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:07.693096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Terminating (SIGTERM) 02:50:07.732848 run iperf3-srv_10.42.42.10(pid=15619): Terminating (SIGTERM) 02:50:07.772727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminating (SIGTERM) 02:50:07.812988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminating (SIGTERM) 02:50:07.853240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Terminating (SIGTERM) 02:50:07.893237 --- ParallelTerminationStrategy: PID 15617 died... 02:50:07.912311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15617): Terminated: ok {rc=0} 02:50:07.956842 --- ParallelTerminationStrategy: PID 15619 died... 02:50:07.975440 run iperf3-srv_10.42.42.10(pid=15619): Terminated {rc=256} 02:50:08.019644 --- ParallelTerminationStrategy: PID 15622 died... 02:50:08.038298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15622): Terminated: ok {rc=0} 02:50:08.082831 --- ParallelTerminationStrategy: PID 15625 died... 02:50:08.101426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15625): Terminated: ok {rc=0} 02:50:08.145657 --- ParallelTerminationStrategy: PID 15628 died... 02:50:08.164306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15628): Terminated: ok {rc=0} 02:50:08.250815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:50:09.399012 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:09.410659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:09.481435 tst iperf3m4.py: using LAC 25468 02:50:09.601123 tst iperf3m4.py: using RAC 223 02:50:09.719003 tst iperf3m4.py: using CellId 25468 02:50:09.840311 tst iperf3m4.py: using BVCI 25469 02:50:09.959249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:09.970944 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:09.982349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:09.994471 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:10.005950 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:10.017463 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:10.029211 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:10.040320 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:10.051839 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:10.171487 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:10.290733 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:10.408613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:10.526295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:10.729066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:11.031642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Launched 02:50:11.295455 run iperf3-srv_10.42.42.10(pid=15631): Launched 02:50:11.409065 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:50:11.610362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:11.913554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Launched 02:50:12.177404 run iperf3-srv_10.42.42.10(pid=15633): Launched 02:50:12.291415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:50:12.493778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:12.797047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Launched 02:50:13.059420 run iperf3-srv_10.42.42.10(pid=15635): Launched 02:50:13.173076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:50:13.375087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:13.676445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15636): Launched 02:50:13.940434 run iperf3-srv_10.42.42.10(pid=15637): Launched 02:50:14.054294 tst iperf3m4.py:8: start network... 02:50:14.255142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:14.722395 run create_hlr_db(pid=15638): Launched 02:50:14.839546 bus /gobi_6: Setting Powered False 02:50:15.921187 run create_hlr_db(pid=15638): Terminated: ok {rc=0} 02:50:16.361032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15640): Launched 02:50:16.680534 run osmo-hlr_10.42.42.2(pid=15641): Launched 02:50:16.912830 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:17.628411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15643): Launched 02:50:17.952004 run osmo-stp_10.42.42.5(pid=15644): Launched 02:50:18.075516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:18.633638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15646): Launched 02:50:18.757757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:19.031009 run patchelf(pid=15647): Launched 02:50:19.211149 run osmo-stp_10.42.42.5(pid=15644): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15644)] 02:50:19.348178 run osmo-stp_10.42.42.5(pid=15644): stdout: | (launched: 2022-12-10_02:50:17.892679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:19.486090 run osmo-stp_10.42.42.5(pid=15644): stderr: | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025018084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:19.623832 run osmo-stp_10.42.42.5(pid=15644): stdout: | (launched: 2022-12-10_02:50:17.892679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:19.756791 run osmo-stp_10.42.42.5(pid=15644): stderr: | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025018084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025018084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025018085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:19.914412 run patchelf(pid=15647): Terminating (SIGINT) 02:50:20.095879 run patchelf(pid=15647): Terminated: ok {rc=0} 02:50:20.226316 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15644): Process ended prematurely: osmo-stp_10.42.42.5(pid=15644) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15644)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:50:20.236517 tst iperf3m4.py:8: Test FAILED (10.9 sec) 02:50:20.265444 run osmo-hlr_10.42.42.2(pid=15641): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15641)] 02:50:20.316104 run osmo-hlr_10.42.42.2(pid=15641): stdout: | (launched: 2022-12-10_02:50:16.613754) 02:50:20.368251 run osmo-hlr_10.42.42.2(pid=15641): stderr: | [0;m[1;31m20221210025016957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025016958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025016958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025016958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025016958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025016958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025016973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025016989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025016989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025016989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:20.420616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Terminating (SIGTERM) 02:50:20.462788 run iperf3-srv_10.42.42.10(pid=15631): Terminating (SIGTERM) 02:50:20.505085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Terminating (SIGTERM) 02:50:20.547234 run iperf3-srv_10.42.42.10(pid=15633): Terminating (SIGTERM) 02:50:20.589148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Terminating (SIGTERM) 02:50:20.631198 run iperf3-srv_10.42.42.10(pid=15635): Terminating (SIGTERM) 02:50:20.672674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15636): Terminating (SIGTERM) 02:50:20.714356 run iperf3-srv_10.42.42.10(pid=15637): Terminating (SIGTERM) 02:50:20.756024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15640): Terminating (SIGTERM) 02:50:20.797576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15643): Terminating (SIGTERM) 02:50:20.839189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15646): Terminating (SIGTERM) 02:50:20.880904 --- ParallelTerminationStrategy: PID 15630 died... 02:50:20.900881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Terminated: ok {rc=0} 02:50:20.947414 --- ParallelTerminationStrategy: PID 15631 died... 02:50:20.966936 run iperf3-srv_10.42.42.10(pid=15631): Terminated {rc=256} 02:50:21.012716 --- ParallelTerminationStrategy: PID 15632 died... 02:50:21.032272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Terminated: ok {rc=0} 02:50:21.078745 --- ParallelTerminationStrategy: PID 15633 died... 02:50:21.098329 run iperf3-srv_10.42.42.10(pid=15633): Terminated {rc=256} 02:50:21.144049 --- ParallelTerminationStrategy: PID 15634 died... 02:50:21.163594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Terminated: ok {rc=0} 02:50:21.209244 --- ParallelTerminationStrategy: PID 15635 died... 02:50:21.228778 run iperf3-srv_10.42.42.10(pid=15635): Terminated {rc=256} 02:50:21.274737 --- ParallelTerminationStrategy: PID 15636 died... 02:50:21.294773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15636): Terminated: ok {rc=0} 02:50:21.340761 --- ParallelTerminationStrategy: PID 15637 died... 02:50:21.360267 run iperf3-srv_10.42.42.10(pid=15637): Terminated {rc=256} 02:50:21.406842 --- ParallelTerminationStrategy: PID 15640 died... 02:50:21.426475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15640): Terminated: ok {rc=0} 02:50:21.472409 --- ParallelTerminationStrategy: PID 15643 died... 02:50:21.492108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15643): Terminated: ok {rc=0} 02:50:21.538139 --- ParallelTerminationStrategy: PID 15646 died... 02:50:21.557508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15646): Terminated: ok {rc=0} 02:50:21.644511 bus /gobi_4: Setting Powered False 02:50:22.743913 bus /gobi_4: Setting Powered False 02:50:23.859308 bus /gobi_1: Setting Powered False 02:50:24.954882 bus /gobi_1: Setting Powered False 02:50:26.069876 bus /gobi_0: Setting Powered False 02:50:27.167963 bus /gobi_0: Setting Powered False 02:50:28.283827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:50:29.386521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.398171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:29.468306 tst ping.py: using LAC 25469 02:50:29.584415 tst ping.py: using RAC 224 02:50:29.701052 tst ping.py: using CellId 25469 02:50:29.819685 tst ping.py: using BVCI 25470 02:50:29.928357 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.939235 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.950022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.960924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.972501 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.983717 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.994755 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.005730 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:30.120881 tst ping.py:19: start network... 02:50:30.318385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:30.776290 run create_hlr_db(pid=15650): Launched 02:50:30.894466 bus /gobi_6: Setting Powered False 02:50:31.957245 run create_hlr_db(pid=15650): Terminated: ok {rc=0} 02:50:32.406325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Launched 02:50:32.723411 run osmo-hlr_10.42.42.2(pid=15653): Launched 02:50:32.844341 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:33.390000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Launched 02:50:33.705144 run osmo-stp_10.42.42.5(pid=15656): Launched 02:50:33.826016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:34.371615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Launched 02:50:34.493129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:34.760479 run patchelf(pid=15659): Launched 02:50:34.937534 run osmo-stp_10.42.42.5(pid=15656): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] 02:50:35.072153 run osmo-stp_10.42.42.5(pid=15656): stdout: | (launched: 2022-12-10_02:50:33.647597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:35.208160 run osmo-stp_10.42.42.5(pid=15656): stderr: | [0;m[38;5;43m20221210025033838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025033838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025033839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025033842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:35.345111 run osmo-stp_10.42.42.5(pid=15656): stdout: | (launched: 2022-12-10_02:50:33.647597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:35.475115 run osmo-stp_10.42.42.5(pid=15656): stderr: | [0;m[38;5;43m20221210025033838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025033838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025033839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025033839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025033842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:35.629186 run patchelf(pid=15659): Terminating (SIGINT) 02:50:35.807146 run patchelf(pid=15659): Terminated: ok {rc=0} 02:50:35.935146 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15656): Process ended prematurely: osmo-stp_10.42.42.5(pid=15656) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 02:50:35.944411 tst ping.py:22: Test FAILED (6.6 sec) 02:50:35.972719 run osmo-hlr_10.42.42.2(pid=15653): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15653)] 02:50:36.023129 run osmo-hlr_10.42.42.2(pid=15653): stdout: | (launched: 2022-12-10_02:50:32.665997) 02:50:36.075382 run osmo-hlr_10.42.42.2(pid=15653): stderr: | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025032865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025032886 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025032896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025032897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025032897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:36.127846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Terminating (SIGTERM) 02:50:36.169912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Terminating (SIGTERM) 02:50:36.211986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Terminating (SIGTERM) 02:50:36.254398 --- ParallelTerminationStrategy: PID 15652 died... 02:50:36.274416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15652): Terminated: ok {rc=0} 02:50:36.321096 --- ParallelTerminationStrategy: PID 15655 died... 02:50:36.340656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15655): Terminated: ok {rc=0} 02:50:36.386900 --- ParallelTerminationStrategy: PID 15658 died... 02:50:36.406521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15658): Terminated: ok {rc=0} 02:50:36.494727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:50:37.581523 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.593171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:37.668219 tst ping_idle_ping.py: using LAC 25470 02:50:37.784880 tst ping_idle_ping.py: using RAC 225 02:50:37.900171 tst ping_idle_ping.py: using CellId 25470 02:50:38.019044 tst ping_idle_ping.py: using BVCI 25471 02:50:38.127506 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.138458 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.149835 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.160936 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.171959 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.183096 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.194309 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:38.205495 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:38.324747 tst ping_idle_ping.py:24: start network... 02:50:38.539629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:39.030348 run create_hlr_db(pid=15660): Launched 02:50:39.158861 bus /gobi_6: Setting Powered False 02:50:40.221654 run create_hlr_db(pid=15660): Terminated: ok {rc=0} 02:50:40.647573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Launched 02:50:40.946109 run osmo-hlr_10.42.42.2(pid=15663): Launched 02:50:41.061267 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:41.573611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Launched 02:50:41.873764 run osmo-stp_10.42.42.5(pid=15666): Launched 02:50:41.987810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:42.502098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Launched 02:50:42.616522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:42.867642 run patchelf(pid=15669): Launched 02:50:43.034173 run osmo-stp_10.42.42.5(pid=15666): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] 02:50:43.161494 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-10_02:50:41.819371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:43.289713 run osmo-stp_10.42.42.5(pid=15666): stderr: | [0;m[38;5;43m20221210025041990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025041990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025041991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025041991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025041991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025041991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025041992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:43.418794 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-10_02:50:41.819371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:43.541421 run osmo-stp_10.42.42.5(pid=15666): stderr: | [0;m[38;5;43m20221210025041990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025041990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025041991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025041991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025041991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025041991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025041992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:43.686636 run patchelf(pid=15669): Terminating (SIGINT) 02:50:43.854600 run patchelf(pid=15669): Terminated: ok {rc=0} 02:50:43.975011 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:50:43.983841 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:50:44.011066 run osmo-hlr_10.42.42.2(pid=15663): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15663)] 02:50:44.058831 run osmo-hlr_10.42.42.2(pid=15663): stdout: | (launched: 2022-12-10_02:50:40.891099) 02:50:44.108786 run osmo-hlr_10.42.42.2(pid=15663): stderr: | [0;m[1;31m20221210025041065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025041065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025041065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025041066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025041066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025041066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025041078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025041088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025041089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025041089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:44.158716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminating (SIGTERM) 02:50:44.198524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminating (SIGTERM) 02:50:44.238254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminating (SIGTERM) 02:50:44.278382 --- ParallelTerminationStrategy: PID 15662 died... 02:50:44.297475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminated: ok {rc=0} 02:50:44.342253 --- ParallelTerminationStrategy: PID 15665 died... 02:50:44.360895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminated: ok {rc=0} 02:50:44.405451 --- ParallelTerminationStrategy: PID 15668 died... 02:50:44.424054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminated: ok {rc=0} 02:50:44.508360 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:50:45.815752 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:50:45.822988 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:50:45.875706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:50:45.918937 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:50:46.012671 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:50:46.062475 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:50:46.111667 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:50:46.739473 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:50:46.793300 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:46.805589 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:50:46.861697 tst cs_paging_gprs_active.py: using LAC 25471 02:50:46.990818 tst cs_paging_gprs_active.py: using RAC 226 02:50:47.152806 tst cs_paging_gprs_active.py: using CellId 25471 02:50:47.293384 tst cs_paging_gprs_active.py: using BVCI 25472 02:50:47.406220 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.417652 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.428792 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.440235 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.451756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.463067 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.474635 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.485891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:47.497359 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:50:47.613738 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:50:47.730513 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:50:47.933892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:48.240391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15673): Launched 02:50:48.504230 run iperf3-srv_10.42.42.10(pid=15674): Launched 02:50:48.619385 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:50:48.821878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:49.125530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15675): Launched 02:50:49.390722 run iperf3-srv_10.42.42.10(pid=15676): Launched 02:50:49.505482 tst cs_paging_gprs_active.py:38: start network... 02:50:49.707360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:50.176257 run create_hlr_db(pid=15677): Launched 02:50:50.293839 bus /gobi_6: Setting Powered False 02:50:51.354567 run create_hlr_db(pid=15677): Terminated: ok {rc=0} 02:50:51.796106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Launched 02:50:52.119943 run osmo-hlr_10.42.42.2(pid=15680): Launched 02:50:52.245508 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:52.802375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Launched 02:50:53.125187 run osmo-stp_10.42.42.5(pid=15683): Launched 02:50:53.250011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:53.812005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15685): Launched 02:50:53.935533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:54.209156 run patchelf(pid=15686): Launched 02:50:54.389789 run osmo-stp_10.42.42.5(pid=15683): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] 02:50:54.526394 run osmo-stp_10.42.42.5(pid=15683): stdout: | (launched: 2022-12-10_02:50:53.066221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:54.664523 run osmo-stp_10.42.42.5(pid=15683): stderr: | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025053258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:54.802352 run osmo-stp_10.42.42.5(pid=15683): stdout: | (launched: 2022-12-10_02:50:53.066221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:54.934992 run osmo-stp_10.42.42.5(pid=15683): stderr: | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025053258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025053258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025053259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:55.091924 run patchelf(pid=15686): Terminating (SIGINT) 02:50:55.272249 run patchelf(pid=15686): Terminated: ok {rc=0} 02:50:55.403261 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15683): Process ended prematurely: osmo-stp_10.42.42.5(pid=15683) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:50:55.413254 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:50:55.441701 run osmo-hlr_10.42.42.2(pid=15680): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15680)] 02:50:55.491576 run osmo-hlr_10.42.42.2(pid=15680): stdout: | (launched: 2022-12-10_02:50:52.060810) 02:50:55.543171 run osmo-hlr_10.42.42.2(pid=15680): stderr: | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025052260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025052272 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025052280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025052280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025052280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:55.595555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15673): Terminating (SIGTERM) 02:50:55.637123 run iperf3-srv_10.42.42.10(pid=15674): Terminating (SIGTERM) 02:50:55.678755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15675): Terminating (SIGTERM) 02:50:55.720468 run iperf3-srv_10.42.42.10(pid=15676): Terminating (SIGTERM) 02:50:55.762088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Terminating (SIGTERM) 02:50:55.803802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Terminating (SIGTERM) 02:50:55.845383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15685): Terminating (SIGTERM) 02:50:55.887127 --- ParallelTerminationStrategy: PID 15673 died... 02:50:55.907161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15673): Terminated: ok {rc=0} 02:50:55.953352 --- ParallelTerminationStrategy: PID 15674 died... 02:50:55.972739 run iperf3-srv_10.42.42.10(pid=15674): Terminated {rc=256} 02:50:56.018520 --- ParallelTerminationStrategy: PID 15675 died... 02:50:56.037969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15675): Terminated: ok {rc=0} 02:50:56.083909 --- ParallelTerminationStrategy: PID 15676 died... 02:50:56.103351 run iperf3-srv_10.42.42.10(pid=15676): Terminated {rc=256} 02:50:56.149129 --- ParallelTerminationStrategy: PID 15679 died... 02:50:56.168570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Terminated: ok {rc=0} 02:50:56.215013 --- ParallelTerminationStrategy: PID 15682 died... 02:50:56.234538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Terminated: ok {rc=0} 02:50:56.280630 --- ParallelTerminationStrategy: PID 15685 died... 02:50:56.300113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15685): Terminated: ok {rc=0} 02:50:56.389059 bus /gobi_0: Setting Powered False 02:50:57.489096 bus /gobi_0: Setting Powered False 02:50:58.605377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:50:59.754137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:59.766418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:50:59.821567 tst iperf3.py: using LAC 25472 02:50:59.948776 tst iperf3.py: using RAC 227 02:51:00.074489 tst iperf3.py: using CellId 25472 02:51:00.201738 tst iperf3.py: using BVCI 25473 02:51:00.319285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.331197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.342734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.354476 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.366027 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.377533 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.389139 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.400472 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:00.412209 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:00.527907 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:00.731201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:01.059766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15687): Launched 02:51:01.343724 run iperf3-srv_10.42.42.10(pid=15688): Launched 02:51:01.504557 tst iperf3.py:8: start network... 02:51:01.716473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:02.200573 run create_hlr_db(pid=15689): Launched 02:51:02.335603 bus /gobi_6: Setting Powered False 02:51:03.399498 run create_hlr_db(pid=15689): Terminated: ok {rc=0} 02:51:03.848037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15691): Launched 02:51:04.170768 run osmo-hlr_10.42.42.2(pid=15692): Launched 02:51:04.294022 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:04.849698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15694): Launched 02:51:05.172253 run osmo-stp_10.42.42.5(pid=15695): Launched 02:51:05.295036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:05.853184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15697): Launched 02:51:05.976613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:06.249208 run patchelf(pid=15698): Launched 02:51:06.430122 run osmo-stp_10.42.42.5(pid=15695): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15695)] 02:51:06.566432 run osmo-stp_10.42.42.5(pid=15695): stdout: | (launched: 2022-12-10_02:51:05.113497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:06.704364 run osmo-stp_10.42.42.5(pid=15695): stderr: | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025105305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:06.842007 run osmo-stp_10.42.42.5(pid=15695): stdout: | (launched: 2022-12-10_02:51:05.113497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:06.974395 run osmo-stp_10.42.42.5(pid=15695): stderr: | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025105305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025105305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025105308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:07.131205 run patchelf(pid=15698): Terminating (SIGINT) 02:51:07.312915 run patchelf(pid=15698): Terminated: ok {rc=0} 02:51:07.443707 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15695): Process ended prematurely: osmo-stp_10.42.42.5(pid=15695) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15695)] [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:51:07.453711 tst iperf3.py:8: Test FAILED (7.7 sec) 02:51:07.482057 run osmo-hlr_10.42.42.2(pid=15692): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15692)] 02:51:07.531841 run osmo-hlr_10.42.42.2(pid=15692): stdout: | (launched: 2022-12-10_02:51:04.111882) 02:51:07.583273 run osmo-hlr_10.42.42.2(pid=15692): stderr: | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025104309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025104321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025104330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025104330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025104330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:07.635251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15687): Terminating (SIGTERM) 02:51:07.676774 run iperf3-srv_10.42.42.10(pid=15688): Terminating (SIGTERM) 02:51:07.718156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15691): Terminating (SIGTERM) 02:51:07.759739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15694): Terminating (SIGTERM) 02:51:07.801152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15697): Terminating (SIGTERM) 02:51:07.842684 --- ParallelTerminationStrategy: PID 15687 died... 02:51:07.862529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15687): Terminated: ok {rc=0} 02:51:07.908231 --- ParallelTerminationStrategy: PID 15688 died... 02:51:07.927626 run iperf3-srv_10.42.42.10(pid=15688): Terminated {rc=256} 02:51:07.973239 --- ParallelTerminationStrategy: PID 15691 died... 02:51:07.992418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15691): Terminated: ok {rc=0} 02:51:08.038111 --- ParallelTerminationStrategy: PID 15694 died... 02:51:08.057456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15694): Terminated: ok {rc=0} 02:51:08.102898 --- ParallelTerminationStrategy: PID 15697 died... 02:51:08.122413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15697): Terminated: ok {rc=0} 02:51:08.208730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:51:09.361730 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.374446 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:09.428644 tst iperf3m4.py: using LAC 25473 02:51:09.555649 tst iperf3m4.py: using RAC 228 02:51:09.685548 tst iperf3m4.py: using CellId 25473 02:51:09.811880 tst iperf3m4.py: using BVCI 25474 02:51:09.929930 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.942097 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.953665 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.965903 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.977907 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:09.989859 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:10.002036 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:10.013971 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:10.026225 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:10.144852 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:10.264241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:10.382606 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:10.498627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:10.700395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:11.003131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15699): Launched 02:51:11.266577 run iperf3-srv_10.42.42.10(pid=15700): Launched 02:51:11.380782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:51:11.582236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:11.885023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15701): Launched 02:51:12.148346 run iperf3-srv_10.42.42.10(pid=15702): Launched 02:51:12.262921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:51:12.465086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:12.768280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15703): Launched 02:51:13.031411 run iperf3-srv_10.42.42.10(pid=15704): Launched 02:51:13.145571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:51:13.346935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:13.649141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15705): Launched 02:51:13.912250 run iperf3-srv_10.42.42.10(pid=15706): Launched 02:51:14.026327 tst iperf3m4.py:8: start network... 02:51:14.227693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:14.695278 run create_hlr_db(pid=15707): Launched 02:51:14.811886 bus /gobi_6: Setting Powered False 02:51:15.895827 run create_hlr_db(pid=15707): Terminated: ok {rc=0} 02:51:16.367703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15709): Launched 02:51:16.689353 run osmo-hlr_10.42.42.2(pid=15710): Launched 02:51:17.011869 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:17.752480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15712): Launched 02:51:18.076177 run osmo-stp_10.42.42.5(pid=15713): Launched 02:51:18.199256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:18.757252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15715): Launched 02:51:18.881481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:19.154208 run patchelf(pid=15716): Launched 02:51:19.334918 run osmo-stp_10.42.42.5(pid=15713): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15713)] 02:51:19.471779 run osmo-stp_10.42.42.5(pid=15713): stdout: | (launched: 2022-12-10_02:51:18.017397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:19.609744 run osmo-stp_10.42.42.5(pid=15713): stderr: | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025118210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:19.747632 run osmo-stp_10.42.42.5(pid=15713): stdout: | (launched: 2022-12-10_02:51:18.017397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:19.880203 run osmo-stp_10.42.42.5(pid=15713): stderr: | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025118210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025118210 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025118211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:20.037539 run patchelf(pid=15716): Terminating (SIGINT) 02:51:20.218430 run patchelf(pid=15716): Terminated: ok {rc=0} 02:51:20.349344 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15713): Process ended prematurely: osmo-stp_10.42.42.5(pid=15713) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15713)] [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:51:20.359424 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:51:20.388743 run osmo-hlr_10.42.42.2(pid=15710): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15710)] 02:51:20.438848 run osmo-hlr_10.42.42.2(pid=15710): stdout: | (launched: 2022-12-10_02:51:16.626236) 02:51:20.490444 run osmo-hlr_10.42.42.2(pid=15710): stderr: | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025116927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025116942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025116963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025116964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025116964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:20.542601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15699): Terminating (SIGTERM) 02:51:20.584326 run iperf3-srv_10.42.42.10(pid=15700): Terminating (SIGTERM) 02:51:20.625964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15701): Terminating (SIGTERM) 02:51:20.667558 run iperf3-srv_10.42.42.10(pid=15702): Terminating (SIGTERM) 02:51:20.709066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15703): Terminating (SIGTERM) 02:51:20.750786 run iperf3-srv_10.42.42.10(pid=15704): Terminating (SIGTERM) 02:51:20.792277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15705): Terminating (SIGTERM) 02:51:20.833790 run iperf3-srv_10.42.42.10(pid=15706): Terminating (SIGTERM) 02:51:20.875265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15709): Terminating (SIGTERM) 02:51:20.917014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15712): Terminating (SIGTERM) 02:51:20.958767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15715): Terminating (SIGTERM) 02:51:21.000558 --- ParallelTerminationStrategy: PID 15699 died... 02:51:21.020510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15699): Terminated: ok {rc=0} 02:51:21.066847 --- ParallelTerminationStrategy: PID 15700 died... 02:51:21.086370 run iperf3-srv_10.42.42.10(pid=15700): Terminated {rc=256} 02:51:21.132130 --- ParallelTerminationStrategy: PID 15701 died... 02:51:21.151823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15701): Terminated: ok {rc=0} 02:51:21.197684 --- ParallelTerminationStrategy: PID 15702 died... 02:51:21.217177 run iperf3-srv_10.42.42.10(pid=15702): Terminated {rc=256} 02:51:21.262718 --- ParallelTerminationStrategy: PID 15703 died... 02:51:21.282219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15703): Terminated: ok {rc=0} 02:51:21.328558 --- ParallelTerminationStrategy: PID 15704 died... 02:51:21.348183 run iperf3-srv_10.42.42.10(pid=15704): Terminated {rc=256} 02:51:21.393872 --- ParallelTerminationStrategy: PID 15705 died... 02:51:21.413528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15705): Terminated: ok {rc=0} 02:51:21.459278 --- ParallelTerminationStrategy: PID 15706 died... 02:51:21.478786 run iperf3-srv_10.42.42.10(pid=15706): Terminated {rc=256} 02:51:21.524445 --- ParallelTerminationStrategy: PID 15709 died... 02:51:21.544039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15709): Terminated: ok {rc=0} 02:51:21.590072 --- ParallelTerminationStrategy: PID 15712 died... 02:51:21.609716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15712): Terminated: ok {rc=0} 02:51:21.655367 --- ParallelTerminationStrategy: PID 15715 died... 02:51:21.674903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15715): Terminated: ok {rc=0} 02:51:21.762188 bus /gobi_4: Setting Powered False 02:51:22.860295 bus /gobi_4: Setting Powered False 02:51:23.975982 bus /gobi_1: Setting Powered False 02:51:25.075106 bus /gobi_1: Setting Powered False 02:51:26.191557 bus /gobi_0: Setting Powered False 02:51:27.289477 bus /gobi_0: Setting Powered False 02:51:28.401784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:51:29.504434 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.516802 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:29.571862 tst ping.py: using LAC 25474 02:51:29.696932 tst ping.py: using RAC 229 02:51:29.822487 tst ping.py: using CellId 25474 02:51:29.947793 tst ping.py: using BVCI 25475 02:51:30.056852 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.068366 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.079595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.091176 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.103167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.115097 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.126587 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:30.137922 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:30.258223 tst ping.py:19: start network... 02:51:30.471711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:30.985734 run create_hlr_db(pid=15717): Launched 02:51:31.129603 bus /gobi_6: Setting Powered False 02:51:32.191449 run create_hlr_db(pid=15717): Terminated: ok {rc=0} 02:51:32.637712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15719): Launched 02:51:32.955489 run osmo-hlr_10.42.42.2(pid=15720): Launched 02:51:33.077914 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:33.625960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15722): Launched 02:51:33.942627 run osmo-stp_10.42.42.5(pid=15723): Launched 02:51:34.063184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:34.612755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15725): Launched 02:51:34.734872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:35.002601 run patchelf(pid=15726): Launched 02:51:35.180169 run osmo-stp_10.42.42.5(pid=15723): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15723)] 02:51:35.314501 run osmo-stp_10.42.42.5(pid=15723): stdout: | (launched: 2022-12-10_02:51:33.885005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:35.450662 run osmo-stp_10.42.42.5(pid=15723): stderr: | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025134080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:35.586645 run osmo-stp_10.42.42.5(pid=15723): stdout: | (launched: 2022-12-10_02:51:33.885005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:35.716758 run osmo-stp_10.42.42.5(pid=15723): stderr: | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025134079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025134080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025134080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:35.870806 run patchelf(pid=15726): Terminating (SIGINT) 02:51:36.048581 run patchelf(pid=15726): Terminated: ok {rc=0} 02:51:36.176581 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15723): Process ended prematurely: osmo-stp_10.42.42.5(pid=15723) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15723)] [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:51:36.186106 tst ping.py:22: Test FAILED (6.7 sec) 02:51:36.214131 run osmo-hlr_10.42.42.2(pid=15720): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15720)] 02:51:36.263867 run osmo-hlr_10.42.42.2(pid=15720): stdout: | (launched: 2022-12-10_02:51:32.898034) 02:51:36.315697 run osmo-hlr_10.42.42.2(pid=15720): stderr: | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025133094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025133106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025133116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025133116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025133117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:36.368341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15719): Terminating (SIGTERM) 02:51:36.410586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15722): Terminating (SIGTERM) 02:51:36.453081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15725): Terminating (SIGTERM) 02:51:36.496085 --- ParallelTerminationStrategy: PID 15719 died... 02:51:36.516599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15719): Terminated: ok {rc=0} 02:51:36.564406 --- ParallelTerminationStrategy: PID 15722 died... 02:51:36.584193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15722): Terminated: ok {rc=0} 02:51:36.630604 --- ParallelTerminationStrategy: PID 15725 died... 02:51:36.650433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15725): Terminated: ok {rc=0} 02:51:36.739363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:51:37.828150 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:37.840928 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:37.899618 tst ping_idle_ping.py: using LAC 25475 02:51:38.023220 tst ping_idle_ping.py: using RAC 230 02:51:38.145811 tst ping_idle_ping.py: using CellId 25475 02:51:38.268399 tst ping_idle_ping.py: using BVCI 25476 02:51:38.385962 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.397770 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.409356 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.420928 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.432473 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.444000 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.455630 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:38.467139 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:38.584655 tst ping_idle_ping.py:24: start network... 02:51:38.784578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:39.247556 run create_hlr_db(pid=15727): Launched 02:51:39.362087 bus /gobi_6: Setting Powered False 02:51:40.422335 run create_hlr_db(pid=15727): Terminated: ok {rc=0} 02:51:40.858651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15729): Launched 02:51:41.176513 run osmo-hlr_10.42.42.2(pid=15730): Launched 02:51:41.297659 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:41.845740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15732): Launched 02:51:42.165705 run osmo-stp_10.42.42.5(pid=15733): Launched 02:51:42.287185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:42.839773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15735): Launched 02:51:42.962200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:43.230203 run patchelf(pid=15736): Launched 02:51:43.408367 run osmo-stp_10.42.42.5(pid=15733): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15733)] 02:51:43.543311 run osmo-stp_10.42.42.5(pid=15733): stdout: | (launched: 2022-12-10_02:51:42.107694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:43.679735 run osmo-stp_10.42.42.5(pid=15733): stderr: | [0;m[38;5;43m20221210025142297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025142297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025142298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025142298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:43.816148 run osmo-stp_10.42.42.5(pid=15733): stdout: | (launched: 2022-12-10_02:51:42.107694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:43.946455 run osmo-stp_10.42.42.5(pid=15733): stderr: | [0;m[38;5;43m20221210025142297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025142297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025142298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025142298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025142300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:44.100674 run patchelf(pid=15736): Terminating (SIGINT) 02:51:44.279022 run patchelf(pid=15736): Terminated: ok {rc=0} 02:51:44.407488 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15733): Process ended prematurely: osmo-stp_10.42.42.5(pid=15733) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15733)] [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:51:44.416845 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:51:44.444753 run osmo-hlr_10.42.42.2(pid=15730): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15730)] 02:51:44.494838 run osmo-hlr_10.42.42.2(pid=15730): stdout: | (launched: 2022-12-10_02:51:41.118466) 02:51:44.546912 run osmo-hlr_10.42.42.2(pid=15730): stderr: | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025141316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025141330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025141338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025141338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025141339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:44.599830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15729): Terminating (SIGTERM) 02:51:44.641656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15732): Terminating (SIGTERM) 02:51:44.683614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15735): Terminating (SIGTERM) 02:51:44.725888 --- ParallelTerminationStrategy: PID 15729 died... 02:51:44.745972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15729): Terminated: ok {rc=0} 02:51:44.792125 --- ParallelTerminationStrategy: PID 15732 died... 02:51:44.811756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15732): Terminated: ok {rc=0} 02:51:44.857508 --- ParallelTerminationStrategy: PID 15735 died... 02:51:44.877130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15735): Terminated: ok {rc=0} 02:51:44.964546 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:51:46.286728 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:51:46.294351 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:51:46.329464 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:51:46.365878 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:51:46.417997 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:51:46.452719 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:51:46.489914 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:51:47.085750 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:51:47.094686 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.110961 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:51:47.193739 tst switch_tch_pdch.py: using LAC 25476 02:51:47.318362 tst switch_tch_pdch.py: using RAC 231 02:51:47.440838 tst switch_tch_pdch.py: using CellId 25476 02:51:47.563480 tst switch_tch_pdch.py: using BVCI 25477 02:51:47.679369 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.691114 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.702721 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.714443 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.726028 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.737374 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.748858 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:47.760363 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:51:47.877565 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:51:47.993189 tst switch_tch_pdch.py:51: start network... 02:51:48.190420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:48.647078 run create_hlr_db(pid=15741): Launched 02:51:48.761229 bus /gobi_6: Setting Powered False 02:51:49.820213 run create_hlr_db(pid=15741): Terminated: ok {rc=0} 02:51:50.232916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15743): Launched 02:51:50.528689 run osmo-hlr_10.42.42.2(pid=15744): Launched 02:51:50.641823 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:51.165439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15746): Launched 02:51:51.461715 run osmo-stp_10.42.42.5(pid=15747): Launched 02:51:51.576321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:52.088326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15749): Launched 02:51:52.202829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:52.452264 run patchelf(pid=15750): Launched 02:51:52.617976 run osmo-stp_10.42.42.5(pid=15747): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15747)] 02:51:52.744139 run osmo-stp_10.42.42.5(pid=15747): stdout: | (launched: 2022-12-10_02:51:51.407842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:52.871536 run osmo-stp_10.42.42.5(pid=15747): stderr: | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025151581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:52.999261 run osmo-stp_10.42.42.5(pid=15747): stdout: | (launched: 2022-12-10_02:51:51.407842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:53.120728 run osmo-stp_10.42.42.5(pid=15747): stderr: | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025151580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025151581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025151581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:53.265050 run patchelf(pid=15750): Terminating (SIGINT) 02:51:53.431274 run patchelf(pid=15750): Terminated: ok {rc=0} 02:51:53.551551 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15747): Process ended prematurely: osmo-stp_10.42.42.5(pid=15747) [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15747)] [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:51:53.560334 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:51:53.586943 run osmo-hlr_10.42.42.2(pid=15744): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15744)] 02:51:53.635115 run osmo-hlr_10.42.42.2(pid=15744): stdout: | (launched: 2022-12-10_02:51:50.474224) 02:51:53.684684 run osmo-hlr_10.42.42.2(pid=15744): stderr: | [0;m[1;31m20221210025150650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025150650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025150650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025150650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025150650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025150651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025150662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025150670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:53.734692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15743): Terminating (SIGTERM) 02:51:53.774544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15746): Terminating (SIGTERM) 02:51:53.814370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15749): Terminating (SIGTERM) 02:51:53.854433 --- ParallelTerminationStrategy: PID 15743 died... 02:51:53.873498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15743): Terminated: ok {rc=0} 02:51:53.918069 --- ParallelTerminationStrategy: PID 15746 died... 02:51:53.936357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15746): Terminated: ok {rc=0} 02:51:53.980931 --- ParallelTerminationStrategy: PID 15749 died... 02:51:53.999458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15749): Terminated: ok {rc=0} 02:51:54.084384 bus /gobi_0: Setting Powered False 02:51:55.183890 bus /gobi_0: Setting Powered False 02:51:56.299783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:51:57.558097 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:51:57.564334 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:51:57.597518 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:51:57.633071 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:51:57.686759 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:51:57.719728 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:51:57.754923 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:51:58.311849 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:51:58.317225 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.328351 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:51:58.403015 tst switch_tch_pdch.py: using LAC 25477 02:51:58.526286 tst switch_tch_pdch.py: using RAC 232 02:51:58.648632 tst switch_tch_pdch.py: using CellId 25477 02:51:58.770726 tst switch_tch_pdch.py: using BVCI 25478 02:51:58.885046 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.896504 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.907756 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.919029 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.930185 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.941510 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.952789 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:51:58.963970 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:51:59.081429 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:51:59.200549 tst switch_tch_pdch.py:51: start network... 02:51:59.413064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:59.872676 run create_hlr_db(pid=15755): Launched 02:51:59.993240 bus /gobi_6: Setting Powered False 02:52:01.051205 run create_hlr_db(pid=15755): Terminated: ok {rc=0} 02:52:01.456126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15757): Launched 02:52:01.777664 run osmo-hlr_10.42.42.2(pid=15758): Launched 02:52:01.927195 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:02.506082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15760): Launched 02:52:02.823765 run osmo-stp_10.42.42.5(pid=15761): Launched 02:52:02.944385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:03.462004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15763): Launched 02:52:03.583683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:03.850509 run patchelf(pid=15764): Launched 02:52:04.027875 run osmo-stp_10.42.42.5(pid=15761): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15761)] 02:52:04.162836 run osmo-stp_10.42.42.5(pid=15761): stdout: | (launched: 2022-12-10_02:52:02.766285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:04.299139 run osmo-stp_10.42.42.5(pid=15761): stderr: | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025202958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:04.435913 run osmo-stp_10.42.42.5(pid=15761): stdout: | (launched: 2022-12-10_02:52:02.766285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:04.566457 run osmo-stp_10.42.42.5(pid=15761): stderr: | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025202957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025202958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025202958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:04.720746 run patchelf(pid=15764): Terminating (SIGINT) 02:52:04.898774 run patchelf(pid=15764): Terminated: ok {rc=0} 02:52:05.026385 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15761): Process ended prematurely: osmo-stp_10.42.42.5(pid=15761) [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15761)] [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:52:05.035841 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:52:05.064373 run osmo-hlr_10.42.42.2(pid=15758): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15758)] 02:52:05.114968 run osmo-hlr_10.42.42.2(pid=15758): stdout: | (launched: 2022-12-10_02:52:01.717860) 02:52:05.167426 run osmo-hlr_10.42.42.2(pid=15758): stderr: | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025202094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025202123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025202148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025202148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025202148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:05.220404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15757): Terminating (SIGTERM) 02:52:05.262823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15760): Terminating (SIGTERM) 02:52:05.305281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15763): Terminating (SIGTERM) 02:52:05.348247 --- ParallelTerminationStrategy: PID 15757 died... 02:52:05.368497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15757): Terminated: ok {rc=0} 02:52:05.415494 --- ParallelTerminationStrategy: PID 15760 died... 02:52:05.435273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15760): Terminated: ok {rc=0} 02:52:05.481893 --- ParallelTerminationStrategy: PID 15763 died... 02:52:05.501656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15763): Terminated: ok {rc=0} 02:52:05.590772 bus /gobi_0: Setting Powered False 02:52:06.691024 bus /gobi_0: Setting Powered False 02:52:07.810401 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:trx-lms --------------------------------------------------------------------- 02:52:09.057222 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:09.060824 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:09.094142 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:52:09.100776 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:09.154858 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:09.188885 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:52:09.195950 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:09.729295 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:09.734450 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 02:52:09.745241 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:09.793274 tst mo_mt_sms.py: using LAC 25478 02:52:09.909313 tst mo_mt_sms.py: using RAC 233 02:52:10.026869 tst mo_mt_sms.py: using CellId 25478 02:52:10.145362 tst mo_mt_sms.py: using BVCI 25479 02:52:10.253935 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:10.373160 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:10.491413 tst mo_mt_sms.py:9: start nitb and bts... 02:52:10.706879 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:52:11.352242 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15769): Launched 02:52:11.669205 run osmo-nitb_10.42.42.2(pid=15770): Launched 02:52:11.844610 run osmo-nitb_10.42.42.2(pid=15770): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15770)] 02:52:11.986959 run osmo-nitb_10.42.42.2(pid=15770): stdout: | (launched: 2022-12-10_02:52:11.611154) 02:52:12.130677 run osmo-nitb_10.42.42.2(pid=15770): stderr: | (launched: 2022-12-10_02:52:11.658403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:12.274394 run osmo-nitb_10.42.42.2(pid=15770): stdout: | (launched: 2022-12-10_02:52:11.611154) 02:52:12.413347 run osmo-nitb_10.42.42.2(pid=15770): stderr: | (launched: 2022-12-10_02:52:11.658403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15770) [trial-2368↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15770)] 02:52:12.788512 tst osmo-nitb_10.42.42.2(pid=15770): stdout: | (launched: 2022-12-10_02:52:11.611154) 02:52:12.916630 tst osmo-nitb_10.42.42.2(pid=15770): stderr: | (launched: 2022-12-10_02:52:11.658403) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:13.067230 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15770) [trial-2368↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15770)] [trial-2368↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 02:52:13.076182 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:52:13.083489 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15769): Terminating (SIGTERM) 02:52:13.294296 --- ParallelTerminationStrategy: PID 15769 died... 02:52:13.316311 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15769): Terminated: ok {rc=0} 02:52:13.406096 bus /sierra_3: Setting Powered False 02:52:14.505728 bus /sierra_3: Setting Powered False 02:52:15.623246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:trx-lms --------------------------------------------------------------------- 02:52:16.824426 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:16.830008 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:16.865329 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:52:16.893600 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:16.957595 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:17.009773 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:52:17.048617 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:17.564735 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:17.571921 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:17.583754 tst sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:17.631507 tst mo_mt_sms.py: using LAC 25479 02:52:17.749876 tst mo_mt_sms.py: using RAC 234 02:52:17.868631 tst mo_mt_sms.py: using CellId 25479 02:52:17.985453 tst mo_mt_sms.py: using BVCI 25480 02:52:18.093761 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:18.104102 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:18.114435 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:18.124901 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:18.135445 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:18.146295 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:18.262628 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:18.378997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:18.836694 run create_hlr_db(pid=15774): Launched 02:52:18.950182 bus /sierra_2: Setting Powered False 02:52:20.008805 run create_hlr_db(pid=15774): Terminated: ok {rc=0} 02:52:20.424547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Launched 02:52:20.720672 run osmo-hlr_10.42.42.2(pid=15777): Launched 02:52:20.833588 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:21.354878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Launched 02:52:21.649361 run osmo-stp_10.42.42.5(pid=15780): Launched 02:52:21.762906 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:22.298577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Launched 02:52:22.594375 run osmo-msc_10.42.42.6(pid=15783): Launched 02:52:22.759840 run osmo-stp_10.42.42.5(pid=15780): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] 02:52:22.885682 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-10_02:52:21.595349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:23.012324 run osmo-stp_10.42.42.5(pid=15780): stderr: | [0;m[38;5;43m20221210025221765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025221765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025221766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025221766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025221766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025221766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025221767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:23.136061 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-10_02:52:21.595349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:23.254097 run osmo-stp_10.42.42.5(pid=15780): stderr: | [0;m[38;5;43m20221210025221765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025221765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025221766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025221766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025221766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025221766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025221767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:23.394793 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2368↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] [trial-2368↪sms:trx-lms↪mo_mt_sms.py:16] 02:52:23.402900 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 02:52:23.428822 run osmo-hlr_10.42.42.2(pid=15777): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15777)] 02:52:23.476579 run osmo-hlr_10.42.42.2(pid=15777): stdout: | (launched: 2022-12-10_02:52:20.666550) 02:52:23.525741 run osmo-hlr_10.42.42.2(pid=15777): stderr: | [0;m[1;31m20221210025220842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025220842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025220843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025220843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025220843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025220843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025220854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025220863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025220863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025220863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:23.594291 run osmo-msc_10.42.42.6(pid=15783): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15783)] 02:52:23.641621 run osmo-msc_10.42.42.6(pid=15783): stdout: | (launched: 2022-12-10_02:52:22.539971) 02:52:23.690710 run osmo-msc_10.42.42.6(pid=15783): stderr: | [0;m[38;5;43m20221210025222809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025222810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe00fde5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025222810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025222810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025222812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025222813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025222813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025222813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:23.740243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminating (SIGTERM) 02:52:23.779927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminating (SIGTERM) 02:52:23.819575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminating (SIGTERM) 02:52:23.859412 --- ParallelTerminationStrategy: PID 15776 died... 02:52:23.878377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminated: ok {rc=0} 02:52:23.922813 --- ParallelTerminationStrategy: PID 15779 died... 02:52:23.941193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminated: ok {rc=0} 02:52:23.985125 --- ParallelTerminationStrategy: PID 15782 died... 02:52:24.003437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminated: ok {rc=0} 02:52:24.088887 bus /sierra_3: Setting Powered False 02:52:25.187353 bus /sierra_3: Setting Powered False 02:52:26.300647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-lms --------------------------------------------------------------------- 02:52:27.524133 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:27.528041 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:27.561232 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:52:27.567843 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:52:27.602525 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:27.634866 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:52:27.641447 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:52:28.161015 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 02:52:28.165889 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 02:52:28.176302 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 02:52:28.223546 tst assert_extension.py: using LAC 25480 02:52:28.340361 tst assert_extension.py: using RAC 235 02:52:28.458517 tst assert_extension.py: using CellId 25480 02:52:28.577769 tst assert_extension.py: using BVCI 25481 02:52:28.693327 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 02:52:28.807217 tst assert_extension.py:10: start nitb and bts... 02:52:29.005828 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:52:29.609298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15789): Launched 02:52:29.904712 run osmo-nitb_10.42.42.2(pid=15790): Launched 02:52:30.068859 run osmo-nitb_10.42.42.2(pid=15790): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15790)] 02:52:30.202414 run osmo-nitb_10.42.42.2(pid=15790): stdout: | (launched: 2022-12-10_02:52:29.850786) 02:52:30.336758 run osmo-nitb_10.42.42.2(pid=15790): stderr: | (launched: 2022-12-10_02:52:29.894723) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:30.471365 run osmo-nitb_10.42.42.2(pid=15790): stdout: | (launched: 2022-12-10_02:52:29.850786) 02:52:30.600321 run osmo-nitb_10.42.42.2(pid=15790): stderr: | (launched: 2022-12-10_02:52:29.894723) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15790) [trial-2368↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15790)] 02:52:31.016052 tst osmo-nitb_10.42.42.2(pid=15790): stdout: | (launched: 2022-12-10_02:52:29.850786) 02:52:31.147962 tst osmo-nitb_10.42.42.2(pid=15790): stderr: | (launched: 2022-12-10_02:52:29.894723) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:31.293074 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15790) [trial-2368↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15790)] [trial-2368↪nitb_ussd:trx-lms↪assert_extension.py:12] 02:52:31.302592 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:52:31.310096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15789): Terminating (SIGTERM) 02:52:31.523505 --- ParallelTerminationStrategy: PID 15789 died... 02:52:31.543076 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15789): Terminated: ok {rc=0} 02:52:31.631784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:trx-lms --------------------------------------------------------------------- 02:52:32.810603 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:32.814766 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:32.848761 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:52:32.875896 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:52:32.913061 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:32.948108 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:52:32.975896 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:52:33.502197 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:trx-lms assert_extension.py ---------------------------------------------- 02:52:33.507305 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:33.518267 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 02:52:33.568230 tst assert_extension.py: using LAC 25481 02:52:33.697102 tst assert_extension.py: using RAC 236 02:52:33.821021 tst assert_extension.py: using CellId 25481 02:52:33.943653 tst assert_extension.py: using BVCI 25482 02:52:34.059272 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:34.070282 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:34.081091 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:34.092347 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:34.103238 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:34.114059 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 02:52:34.228805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:34.686341 run create_hlr_db(pid=15794): Launched 02:52:34.800089 bus /sierra_2: Setting Powered False 02:52:35.858868 run create_hlr_db(pid=15794): Terminated: ok {rc=0} 02:52:36.294597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15800): Launched 02:52:36.612422 run osmo-hlr_10.42.42.2(pid=15801): Launched 02:52:36.733903 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:37.279430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15803): Launched 02:52:37.596270 run osmo-stp_10.42.42.5(pid=15804): Launched 02:52:37.717512 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:38.288689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15806): Launched 02:52:38.605733 run osmo-msc_10.42.42.6(pid=15807): Launched 02:52:38.781980 run osmo-stp_10.42.42.5(pid=15804): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15804)] 02:52:38.915206 run osmo-stp_10.42.42.5(pid=15804): stdout: | (launched: 2022-12-10_02:52:37.538601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:39.050132 run osmo-stp_10.42.42.5(pid=15804): stderr: | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025237730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:39.183806 run osmo-stp_10.42.42.5(pid=15804): stdout: | (launched: 2022-12-10_02:52:37.538601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:39.309851 run osmo-stp_10.42.42.5(pid=15804): stderr: | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025237729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025237730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025237730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:39.460863 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15804): Process ended prematurely: osmo-stp_10.42.42.5(pid=15804) [trial-2368↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15804)] [trial-2368↪ussd:trx-lms↪assert_extension.py:17] 02:52:39.469650 tst assert_extension.py:17: Test FAILED (6.0 sec) 02:52:39.496730 run osmo-hlr_10.42.42.2(pid=15801): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15801)] 02:52:39.546642 run osmo-hlr_10.42.42.2(pid=15801): stdout: | (launched: 2022-12-10_02:52:36.554873) 02:52:39.598327 run osmo-hlr_10.42.42.2(pid=15801): stderr: | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025236752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025236766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025236776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025236776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025236776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:39.670071 run osmo-msc_10.42.42.6(pid=15807): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15807)] 02:52:39.720195 run osmo-msc_10.42.42.6(pid=15807): stdout: | (launched: 2022-12-10_02:52:38.548044) 02:52:39.771517 run osmo-msc_10.42.42.6(pid=15807): stderr: | [0;m[38;5;43m20221210025238869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025238869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38ec197c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025238869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025238869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025238869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025238869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025238871 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025238871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025238872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025238872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:39.823341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15800): Terminating (SIGTERM) 02:52:39.864746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15803): Terminating (SIGTERM) 02:52:39.906380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15806): Terminating (SIGTERM) 02:52:39.948081 --- ParallelTerminationStrategy: PID 15800 died... 02:52:39.967672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15800): Terminated: ok {rc=0} 02:52:40.013690 --- ParallelTerminationStrategy: PID 15803 died... 02:52:40.033177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15803): Terminated: ok {rc=0} 02:52:40.078659 --- ParallelTerminationStrategy: PID 15806 died... 02:52:40.098038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15806): Terminated: ok {rc=0} 02:52:40.184717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:52:41.399353 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:41.406362 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:52:41.440061 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:52:41.467671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:52:41.520274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:52:41.554102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:52:41.581640 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:52:42.134179 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:52:42.186187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.197809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:52:42.269247 tst mo_mt_call.py: using LAC 25482 02:52:42.397104 tst mo_mt_call.py: using RAC 237 02:52:42.524135 tst mo_mt_call.py: using CellId 25482 02:52:42.649983 tst mo_mt_call.py: using BVCI 25483 02:52:42.766556 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.778094 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.789350 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.800774 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.812206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:42.823549 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:42.939571 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:43.059457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:43.562011 run create_hlr_db(pid=15812): Launched 02:52:43.694121 bus /sierra_2: Setting Powered False 02:52:44.757745 run create_hlr_db(pid=15812): Terminated: ok {rc=0} 02:52:45.206804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15814): Launched 02:52:45.536810 run osmo-hlr_10.42.42.2(pid=15815): Launched 02:52:45.659922 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:46.238158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15817): Launched 02:52:46.573745 run osmo-stp_10.42.42.5(pid=15818): Launched 02:52:46.813612 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:47.464937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15820): Launched 02:52:47.767899 run osmo-msc_10.42.42.6(pid=15821): Launched 02:52:47.936478 run osmo-stp_10.42.42.5(pid=15818): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15818)] 02:52:48.064427 run osmo-stp_10.42.42.5(pid=15818): stdout: | (launched: 2022-12-10_02:52:46.505306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:48.192398 run osmo-stp_10.42.42.5(pid=15818): stderr: | [0;m[38;5;43m20221210025246842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025246842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025246843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025246843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025246843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025246844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025246844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:48.318249 run osmo-stp_10.42.42.5(pid=15818): stdout: | (launched: 2022-12-10_02:52:46.505306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:48.438122 run osmo-stp_10.42.42.5(pid=15818): stderr: | [0;m[38;5;43m20221210025246842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025246842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025246843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025246843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025246843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025246844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025246844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:48.581141 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15818): Process ended prematurely: osmo-stp_10.42.42.5(pid=15818) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15818)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:52:48.589951 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:52:48.616897 run osmo-hlr_10.42.42.2(pid=15815): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15815)] 02:52:48.664838 run osmo-hlr_10.42.42.2(pid=15815): stdout: | (launched: 2022-12-10_02:52:45.477821) 02:52:48.714572 run osmo-hlr_10.42.42.2(pid=15815): stderr: | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025245679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025245693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025245701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025245701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025245701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:48.783765 run osmo-msc_10.42.42.6(pid=15821): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15821)] 02:52:48.831755 run osmo-msc_10.42.42.6(pid=15821): stdout: | (launched: 2022-12-10_02:52:47.712736) 02:52:48.881350 run osmo-msc_10.42.42.6(pid=15821): stderr: | [0;m[38;5;43m20221210025247986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025247986 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f906a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025247987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025247987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025247987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025247987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025247989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025247989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025247990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025247990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:48.931366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15814): Terminating (SIGTERM) 02:52:48.971086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15817): Terminating (SIGTERM) 02:52:49.011000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15820): Terminating (SIGTERM) 02:52:49.051006 --- ParallelTerminationStrategy: PID 15814 died... 02:52:49.070274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15814): Terminated: ok {rc=0} 02:52:49.114650 --- ParallelTerminationStrategy: PID 15817 died... 02:52:49.133204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15817): Terminated: ok {rc=0} 02:52:49.177496 --- ParallelTerminationStrategy: PID 15820 died... 02:52:49.196164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15820): Terminated: ok {rc=0} 02:52:49.280558 bus /sierra_3: Setting Powered False 02:52:50.379747 bus /sierra_3: Setting Powered False 02:52:51.498790 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:52:52.645414 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:52.656852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:52:52.726932 tst mo_mt_call_osmux.py: using LAC 25483 02:52:52.846672 tst mo_mt_call_osmux.py: using RAC 238 02:52:52.967327 tst mo_mt_call_osmux.py: using CellId 25483 02:52:53.086077 tst mo_mt_call_osmux.py: using BVCI 25484 02:52:53.198539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:53.209572 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:53.220297 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:53.231418 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:53.242997 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:53.254128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:53.372916 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:53.493829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:53.961819 run create_hlr_db(pid=15823): Launched 02:52:54.077757 bus /sierra_2: Setting Powered False 02:52:55.137868 run create_hlr_db(pid=15823): Terminated: ok {rc=0} 02:52:55.580486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15825): Launched 02:52:55.904397 run osmo-hlr_10.42.42.2(pid=15826): Launched 02:52:56.028177 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:56.586466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15828): Launched 02:52:56.909876 run osmo-stp_10.42.42.5(pid=15829): Launched 02:52:57.033481 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:57.617607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15831): Launched 02:52:57.940319 run osmo-msc_10.42.42.6(pid=15832): Launched 02:52:58.119862 run osmo-stp_10.42.42.5(pid=15829): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15829)] 02:52:58.256018 run osmo-stp_10.42.42.5(pid=15829): stdout: | (launched: 2022-12-10_02:52:56.851034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:58.393271 run osmo-stp_10.42.42.5(pid=15829): stderr: | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025257046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:58.529136 run osmo-stp_10.42.42.5(pid=15829): stdout: | (launched: 2022-12-10_02:52:56.851034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:58.656822 run osmo-stp_10.42.42.5(pid=15829): stderr: | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025257044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025257046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025257047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:58.809718 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15829): Process ended prematurely: osmo-stp_10.42.42.5(pid=15829) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15829)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:52:58.819155 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:52:58.846812 run osmo-hlr_10.42.42.2(pid=15826): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15826)] 02:52:58.896707 run osmo-hlr_10.42.42.2(pid=15826): stdout: | (launched: 2022-12-10_02:52:55.845683) 02:52:58.948172 run osmo-hlr_10.42.42.2(pid=15826): stderr: | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025256047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025256059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025256067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025256068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025256068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:59.020409 run osmo-msc_10.42.42.6(pid=15832): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15832)] 02:52:59.070426 run osmo-msc_10.42.42.6(pid=15832): stdout: | (launched: 2022-12-10_02:52:57.881622) 02:52:59.122130 run osmo-msc_10.42.42.6(pid=15832): stderr: | [0;m[38;5;43m20221210025258206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025258206 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f740caaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025258206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025258206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025258206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025258207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025258208 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025258209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025258209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025258209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:59.174451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15825): Terminating (SIGTERM) 02:52:59.216028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15828): Terminating (SIGTERM) 02:52:59.257824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15831): Terminating (SIGTERM) 02:52:59.299768 --- ParallelTerminationStrategy: PID 15825 died... 02:52:59.319875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15825): Terminated: ok {rc=0} 02:52:59.366799 --- ParallelTerminationStrategy: PID 15828 died... 02:52:59.386341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15828): Terminated: ok {rc=0} 02:52:59.432386 --- ParallelTerminationStrategy: PID 15831 died... 02:52:59.451955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15831): Terminated: ok {rc=0} 02:52:59.539701 bus /sierra_3: Setting Powered False 02:53:00.639815 bus /sierra_3: Setting Powered False 02:53:01.761388 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:53:03.014737 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:03.021252 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:53:03.054463 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:53:03.081200 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:53:03.133894 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:53:03.167207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:53:03.193631 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:53:03.742587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:53:03.791406 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:03.802505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:03.871030 tst mo_mt_call.py: using LAC 25484 02:53:03.988819 tst mo_mt_call.py: using RAC 239 02:53:04.106521 tst mo_mt_call.py: using CellId 25484 02:53:04.227613 tst mo_mt_call.py: using BVCI 25485 02:53:04.347040 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:04.358780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:04.370777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:04.382376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:04.393946 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:04.405433 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:04.520884 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:04.636562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:05.104481 run create_hlr_db(pid=15837): Launched 02:53:05.222528 bus /sierra_2: Setting Powered False 02:53:06.282406 run create_hlr_db(pid=15837): Terminated: ok {rc=0} 02:53:06.724915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Launched 02:53:07.048696 run osmo-hlr_10.42.42.2(pid=15840): Launched 02:53:07.172818 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:07.732739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Launched 02:53:08.053858 run osmo-stp_10.42.42.5(pid=15843): Launched 02:53:08.172289 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:08.722303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Launched 02:53:09.025763 run osmo-msc_10.42.42.6(pid=15846): Launched 02:53:09.196112 run osmo-stp_10.42.42.5(pid=15843): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] 02:53:09.325158 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-10_02:53:07.995331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:09.455257 run osmo-stp_10.42.42.5(pid=15843): stderr: | [0;m[38;5;43m20221210025308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025308167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025308167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025308167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:09.582385 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-10_02:53:07.995331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:09.703239 run osmo-stp_10.42.42.5(pid=15843): stderr: | [0;m[38;5;43m20221210025308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025308167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025308167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025308167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025308168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:09.847538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:53:09.856559 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:53:09.883304 run osmo-hlr_10.42.42.2(pid=15840): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15840)] 02:53:09.931657 run osmo-hlr_10.42.42.2(pid=15840): stdout: | (launched: 2022-12-10_02:53:06.990026) 02:53:09.981344 run osmo-hlr_10.42.42.2(pid=15840): stderr: | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025307190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025307202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025307211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025307211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025307211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:10.050209 run osmo-msc_10.42.42.6(pid=15846): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15846)] 02:53:10.097807 run osmo-msc_10.42.42.6(pid=15846): stdout: | (launched: 2022-12-10_02:53:08.970316) 02:53:10.147249 run osmo-msc_10.42.42.6(pid=15846): stderr: | [0;m[38;5;43m20221210025309241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025309242 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b80a04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025309242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025309242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025309242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025309242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025309244 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025309244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025309244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025309244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:10.197053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminating (SIGTERM) 02:53:10.237087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminating (SIGTERM) 02:53:10.276904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Terminating (SIGTERM) 02:53:10.317052 --- ParallelTerminationStrategy: PID 15839 died... 02:53:10.336016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminated: ok {rc=0} 02:53:10.380848 --- ParallelTerminationStrategy: PID 15842 died... 02:53:10.399521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminated: ok {rc=0} 02:53:10.443825 --- ParallelTerminationStrategy: PID 15845 died... 02:53:10.462382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15845): Terminated: ok {rc=0} 02:53:10.548873 bus /sierra_3: Setting Powered False 02:53:11.649300 bus /sierra_3: Setting Powered False 02:53:12.765038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:53:13.910681 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:13.922273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:13.997514 tst mo_mt_call_osmux.py: using LAC 25485 02:53:14.124058 tst mo_mt_call_osmux.py: using RAC 240 02:53:14.248869 tst mo_mt_call_osmux.py: using CellId 25485 02:53:14.373310 tst mo_mt_call_osmux.py: using BVCI 25486 02:53:14.490271 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:14.501974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:14.513516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:14.524795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:14.536704 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:14.548820 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:14.670627 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:14.788145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:15.257367 run create_hlr_db(pid=15854): Launched 02:53:15.375427 bus /sierra_2: Setting Powered False 02:53:16.466401 run create_hlr_db(pid=15854): Terminated: ok {rc=0} 02:53:16.964513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15905): Launched 02:53:17.301164 run osmo-hlr_10.42.42.2(pid=15913): Launched 02:53:17.576440 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:18.355095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Launched 02:53:18.750264 run osmo-stp_10.42.42.5(pid=16023): Launched 02:53:19.003504 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:19.743812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Launched 02:53:20.074098 run osmo-msc_10.42.42.6(pid=16133): Launched 02:53:20.457724 run osmo-stp_10.42.42.5(pid=16023): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] 02:53:20.725203 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-10_02:53:18.677774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:20.976931 run osmo-stp_10.42.42.5(pid=16023): stderr: | [0;m[38;5;43m20221210025319036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025319036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025319049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025319049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:21.107285 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-10_02:53:18.677774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:21.231768 run osmo-stp_10.42.42.5(pid=16023): stderr: | [0;m[38;5;43m20221210025319036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025319036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025319049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025319049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025319050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:21.379909 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:53:21.389980 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 02:53:21.420510 run osmo-hlr_10.42.42.2(pid=15913): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15913)] 02:53:21.471786 run osmo-hlr_10.42.42.2(pid=15913): stdout: | (launched: 2022-12-10_02:53:17.239984) 02:53:21.524547 run osmo-hlr_10.42.42.2(pid=15913): stderr: | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025317629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025317649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025317663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025317663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025317663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:21.597634 run osmo-msc_10.42.42.6(pid=16133): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16133)] 02:53:21.648508 run osmo-msc_10.42.42.6(pid=16133): stdout: | (launched: 2022-12-10_02:53:20.016388) 02:53:21.701069 run osmo-msc_10.42.42.6(pid=16133): stderr: | [0;m[38;5;43m20221210025320496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025320496 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5920242c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025320496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025320496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025320496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025320505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025320507 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025320507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025320507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025320507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:21.753990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15905): Terminating (SIGTERM) 02:53:21.797503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Terminating (SIGTERM) 02:53:21.844163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Terminating (SIGTERM) 02:53:21.888045 --- ParallelTerminationStrategy: PID 15905 died... 02:53:21.909264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15905): Terminated: ok {rc=0} 02:53:21.958850 --- ParallelTerminationStrategy: PID 15978 died... 02:53:21.978797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Terminated: ok {rc=0} 02:53:22.026528 --- ParallelTerminationStrategy: PID 16131 died... 02:53:22.046418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Terminated: ok {rc=0} 02:53:22.135427 bus /sierra_3: Setting Powered False 02:53:23.237126 bus /sierra_3: Setting Powered False 02:53:24.357471 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:53:25.620134 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:25.627916 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:53:25.664315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:53:25.693168 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:53:25.746284 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:53:25.781431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:53:25.811247 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:53:26.361330 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:53:26.417549 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:26.430240 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:53:26.502225 tst mo_mt_call.py: using LAC 25486 02:53:26.632383 tst mo_mt_call.py: using RAC 241 02:53:26.761228 tst mo_mt_call.py: using CellId 25486 02:53:26.891634 tst mo_mt_call.py: using BVCI 25487 02:53:27.013416 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:27.025991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:27.038357 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:27.051404 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:27.064187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:27.078138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:27.202537 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:27.330342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:27.816248 run create_hlr_db(pid=16140): Launched 02:53:27.976464 bus /sierra_2: Setting Powered False 02:53:29.039328 run create_hlr_db(pid=16140): Terminated: ok {rc=0} 02:53:29.481563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16142): Launched 02:53:29.814367 run osmo-hlr_10.42.42.2(pid=16143): Launched 02:53:30.054597 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:30.798083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16145): Launched 02:53:31.146636 run osmo-stp_10.42.42.5(pid=16146): Launched 02:53:31.467060 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:32.307537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16148): Launched 02:53:32.710471 run osmo-msc_10.42.42.6(pid=16149): Launched 02:53:33.150066 run osmo-stp_10.42.42.5(pid=16146): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16146)] 02:53:33.383532 run osmo-stp_10.42.42.5(pid=16146): stdout: | (launched: 2022-12-10_02:53:31.086566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:33.629618 run osmo-stp_10.42.42.5(pid=16146): stderr: | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025331372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:33.762368 run osmo-stp_10.42.42.5(pid=16146): stdout: | (launched: 2022-12-10_02:53:31.086566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:33.889709 run osmo-stp_10.42.42.5(pid=16146): stderr: | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025331371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025331372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025331372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:34.040495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16146): Process ended prematurely: osmo-stp_10.42.42.5(pid=16146) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16146)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:53:34.050757 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 02:53:34.082967 run osmo-hlr_10.42.42.2(pid=16143): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16143)] 02:53:34.134273 run osmo-hlr_10.42.42.2(pid=16143): stdout: | (launched: 2022-12-10_02:53:29.753994) 02:53:34.186916 run osmo-hlr_10.42.42.2(pid=16143): stderr: | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025330100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025330120 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025330135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025330135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025330135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:34.260882 run osmo-msc_10.42.42.6(pid=16149): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16149)] 02:53:34.311977 run osmo-msc_10.42.42.6(pid=16149): stdout: | (launched: 2022-12-10_02:53:32.637744) 02:53:34.365319 run osmo-msc_10.42.42.6(pid=16149): stderr: | [0;m[38;5;43m20221210025333207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025333208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6fc1fa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025333208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025333208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025333208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025333208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025333210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025333218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025333218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025333218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:34.419497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16142): Terminating (SIGTERM) 02:53:34.462713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16145): Terminating (SIGTERM) 02:53:34.508072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16148): Terminating (SIGTERM) 02:53:34.552791 --- ParallelTerminationStrategy: PID 16142 died... 02:53:34.573353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16142): Terminated: ok {rc=0} 02:53:34.622951 --- ParallelTerminationStrategy: PID 16145 died... 02:53:34.643074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16145): Terminated: ok {rc=0} 02:53:34.692223 --- ParallelTerminationStrategy: PID 16148 died... 02:53:34.712273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16148): Terminated: ok {rc=0} 02:53:34.803960 bus /sierra_3: Setting Powered False 02:53:35.906329 bus /sierra_3: Setting Powered False 02:53:37.023956 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:53:38.176289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.189056 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:53:38.262856 tst mo_mt_call_osmux.py: using LAC 25487 02:53:38.385838 tst mo_mt_call_osmux.py: using RAC 242 02:53:38.509410 tst mo_mt_call_osmux.py: using CellId 25487 02:53:38.633758 tst mo_mt_call_osmux.py: using BVCI 25488 02:53:38.748408 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.760511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.774097 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.787527 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.799651 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:38.813858 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:38.934262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:39.057587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:39.554704 run create_hlr_db(pid=16151): Launched 02:53:39.717436 bus /sierra_2: Setting Powered False 02:53:40.782743 run create_hlr_db(pid=16151): Terminated: ok {rc=0} 02:53:41.225962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Launched 02:53:41.550620 run osmo-hlr_10.42.42.2(pid=16155): Launched 02:53:41.674744 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:42.229673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Launched 02:53:42.553356 run osmo-stp_10.42.42.5(pid=16158): Launched 02:53:42.677223 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:43.262932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16160): Launched 02:53:43.587293 run osmo-msc_10.42.42.6(pid=16161): Launched 02:53:43.767114 run osmo-stp_10.42.42.5(pid=16158): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] 02:53:43.902773 run osmo-stp_10.42.42.5(pid=16158): stdout: | (launched: 2022-12-10_02:53:42.494643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:44.039506 run osmo-stp_10.42.42.5(pid=16158): stderr: | [0;m[38;5;43m20221210025342689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025342690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025342690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025342690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:44.175724 run osmo-stp_10.42.42.5(pid=16158): stdout: | (launched: 2022-12-10_02:53:42.494643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:44.303909 run osmo-stp_10.42.42.5(pid=16158): stderr: | [0;m[38;5;43m20221210025342689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025342690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025342690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025342690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025342691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:44.458044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16158): Process ended prematurely: osmo-stp_10.42.42.5(pid=16158) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:53:44.467278 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:53:44.495157 run osmo-hlr_10.42.42.2(pid=16155): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16155)] 02:53:44.545277 run osmo-hlr_10.42.42.2(pid=16155): stdout: | (launched: 2022-12-10_02:53:41.491695) 02:53:44.596888 run osmo-hlr_10.42.42.2(pid=16155): stderr: | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025341690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025341703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025341711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025341711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025341711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:44.669051 run osmo-msc_10.42.42.6(pid=16161): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16161)] 02:53:44.719190 run osmo-msc_10.42.42.6(pid=16161): stdout: | (launched: 2022-12-10_02:53:43.528219) 02:53:44.770805 run osmo-msc_10.42.42.6(pid=16161): stderr: | [0;m[38;5;43m20221210025343851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025343852 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb902b29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025343852 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025343852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025343852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025343852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025343854 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025343854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025343854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025343854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:44.823393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminating (SIGTERM) 02:53:44.865139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminating (SIGTERM) 02:53:44.907155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16160): Terminating (SIGTERM) 02:53:44.949367 --- ParallelTerminationStrategy: PID 16154 died... 02:53:44.969071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16154): Terminated: ok {rc=0} 02:53:45.015292 --- ParallelTerminationStrategy: PID 16157 died... 02:53:45.034943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16157): Terminated: ok {rc=0} 02:53:45.081206 --- ParallelTerminationStrategy: PID 16160 died... 02:53:45.100775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16160): Terminated: ok {rc=0} 02:53:45.188185 bus /sierra_3: Setting Powered False 02:53:46.287440 bus /sierra_3: Setting Powered False 02:53:47.405607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:53:48.659247 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:48.666570 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:53:48.700247 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:53:48.727662 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:53:48.780253 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:53:48.813148 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:53:48.839425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:53:49.393564 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:53:49.445615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:49.457312 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:53:49.540527 tst mo_mt_call.py: using LAC 25488 02:53:49.669812 tst mo_mt_call.py: using RAC 243 02:53:49.789542 tst mo_mt_call.py: using CellId 25488 02:53:49.911533 tst mo_mt_call.py: using BVCI 25489 02:53:50.021907 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:50.032833 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:50.043654 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:50.054872 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:50.066119 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:50.077313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:53:50.197410 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:53:50.314341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:50.783383 run create_hlr_db(pid=16166): Launched 02:53:50.899664 bus /sierra_2: Setting Powered False 02:53:51.959577 run create_hlr_db(pid=16166): Terminated: ok {rc=0} 02:53:52.381443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16168): Launched 02:53:52.685147 run osmo-hlr_10.42.42.2(pid=16169): Launched 02:53:52.801833 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:53.324100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16171): Launched 02:53:53.627015 run osmo-stp_10.42.42.5(pid=16172): Launched 02:53:53.743251 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:54.289170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16174): Launched 02:53:54.592309 run osmo-msc_10.42.42.6(pid=16175): Launched 02:53:54.762592 run osmo-stp_10.42.42.5(pid=16172): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16172)] 02:53:54.891489 run osmo-stp_10.42.42.5(pid=16172): stdout: | (launched: 2022-12-10_02:53:53.571161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:55.020245 run osmo-stp_10.42.42.5(pid=16172): stderr: | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025353741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:55.146989 run osmo-stp_10.42.42.5(pid=16172): stdout: | (launched: 2022-12-10_02:53:53.571161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:55.266983 run osmo-stp_10.42.42.5(pid=16172): stderr: | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025353740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025353741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025353741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:55.410889 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16172): Process ended prematurely: osmo-stp_10.42.42.5(pid=16172) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16172)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:53:55.419567 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:53:55.446321 run osmo-hlr_10.42.42.2(pid=16169): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16169)] 02:53:55.494523 run osmo-hlr_10.42.42.2(pid=16169): stdout: | (launched: 2022-12-10_02:53:52.629439) 02:53:55.544250 run osmo-hlr_10.42.42.2(pid=16169): stderr: | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025352805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025352817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025352825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025352825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025352825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:55.613816 run osmo-msc_10.42.42.6(pid=16175): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16175)] 02:53:55.661798 run osmo-msc_10.42.42.6(pid=16175): stdout: | (launched: 2022-12-10_02:53:54.536598) 02:53:55.711544 run osmo-msc_10.42.42.6(pid=16175): stderr: | [0;m[38;5;43m20221210025354810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025354810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f923b083c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025354810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025354811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025354811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025354811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025354813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025354814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025354814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025354814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:55.761734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16168): Terminating (SIGTERM) 02:53:55.801497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16171): Terminating (SIGTERM) 02:53:55.841259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16174): Terminating (SIGTERM) 02:53:55.882048 --- ParallelTerminationStrategy: PID 16168 died... 02:53:55.901224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16168): Terminated: ok {rc=0} 02:53:55.945780 --- ParallelTerminationStrategy: PID 16171 died... 02:53:55.964367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16171): Terminated: ok {rc=0} 02:53:56.008766 --- ParallelTerminationStrategy: PID 16174 died... 02:53:56.027524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16174): Terminated: ok {rc=0} 02:53:56.113632 bus /sierra_3: Setting Powered False 02:53:57.214054 bus /sierra_3: Setting Powered False 02:53:58.330797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:53:59.477085 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:59.488718 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:53:59.558016 tst mo_mt_call_osmux.py: using LAC 25489 02:53:59.679121 tst mo_mt_call_osmux.py: using RAC 244 02:53:59.800291 tst mo_mt_call_osmux.py: using CellId 25489 02:53:59.919306 tst mo_mt_call_osmux.py: using BVCI 25490 02:54:00.030966 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:00.042099 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:00.053007 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:00.064120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:00.075403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:00.086470 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:00.202329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:00.323718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:00.829154 run create_hlr_db(pid=16177): Launched 02:54:01.015705 bus /sierra_2: Setting Powered False 02:54:02.074314 run create_hlr_db(pid=16177): Terminated: ok {rc=0} 02:54:02.513469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Launched 02:54:02.818682 run osmo-hlr_10.42.42.2(pid=16180): Launched 02:54:02.934700 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:03.470450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Launched 02:54:03.774612 run osmo-stp_10.42.42.5(pid=16183): Launched 02:54:03.890646 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:04.438114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Launched 02:54:04.743144 run osmo-msc_10.42.42.6(pid=16186): Launched 02:54:04.914135 run osmo-stp_10.42.42.5(pid=16183): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] 02:54:05.043392 run osmo-stp_10.42.42.5(pid=16183): stdout: | (launched: 2022-12-10_02:54:03.718634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:05.173194 run osmo-stp_10.42.42.5(pid=16183): stderr: | [0;m[38;5;43m20221210025403891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025403892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025403892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025403892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:05.300367 run osmo-stp_10.42.42.5(pid=16183): stdout: | (launched: 2022-12-10_02:54:03.718634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:05.421516 run osmo-stp_10.42.42.5(pid=16183): stderr: | [0;m[38;5;43m20221210025403891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025403892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025403892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025403892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025403893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:05.566164 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16183): Process ended prematurely: osmo-stp_10.42.42.5(pid=16183) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:54:05.575056 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:54:05.602183 run osmo-hlr_10.42.42.2(pid=16180): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16180)] 02:54:05.650399 run osmo-hlr_10.42.42.2(pid=16180): stdout: | (launched: 2022-12-10_02:54:02.762905) 02:54:05.700877 run osmo-hlr_10.42.42.2(pid=16180): stderr: | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025402938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025402948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025402957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025402958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025402958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:05.770510 run osmo-msc_10.42.42.6(pid=16186): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16186)] 02:54:05.818930 run osmo-msc_10.42.42.6(pid=16186): stdout: | (launched: 2022-12-10_02:54:04.687257) 02:54:05.869085 run osmo-msc_10.42.42.6(pid=16186): stderr: | [0;m[38;5;43m20221210025404956 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025404957 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3aa730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025404957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025404957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025404957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025404957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025404959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025404959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025404959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025404959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:05.919415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Terminating (SIGTERM) 02:54:05.959541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Terminating (SIGTERM) 02:54:05.999558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Terminating (SIGTERM) 02:54:06.039966 --- ParallelTerminationStrategy: PID 16179 died... 02:54:06.059395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Terminated: ok {rc=0} 02:54:06.104200 --- ParallelTerminationStrategy: PID 16182 died... 02:54:06.123423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Terminated: ok {rc=0} 02:54:06.167901 --- ParallelTerminationStrategy: PID 16185 died... 02:54:06.186565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Terminated: ok {rc=0} 02:54:06.272498 bus /sierra_3: Setting Powered False 02:54:07.372812 bus /sierra_3: Setting Powered False 02:54:08.489623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:54:09.751224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:09.758514 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:54:09.791744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:54:09.818419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:54:09.869581 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:54:09.902839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:54:09.929456 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:54:10.479038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:54:10.528078 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:10.539065 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:54:10.611467 tst mo_mt_call.py: using LAC 25490 02:54:10.730845 tst mo_mt_call.py: using RAC 245 02:54:10.849997 tst mo_mt_call.py: using CellId 25490 02:54:10.972267 tst mo_mt_call.py: using BVCI 25491 02:54:11.083818 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:11.094833 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:11.105700 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:11.116766 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:11.127934 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:11.138939 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:11.259672 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:11.381319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:11.883526 run create_hlr_db(pid=16192): Launched 02:54:12.005489 bus /sierra_2: Setting Powered False 02:54:13.063801 run create_hlr_db(pid=16192): Terminated: ok {rc=0} 02:54:13.485574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Launched 02:54:13.790855 run osmo-hlr_10.42.42.2(pid=16195): Launched 02:54:13.906354 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:14.441498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Launched 02:54:14.748731 run osmo-stp_10.42.42.5(pid=16198): Launched 02:54:14.864173 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:15.413923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16200): Launched 02:54:15.715863 run osmo-msc_10.42.42.6(pid=16201): Launched 02:54:15.926816 run osmo-stp_10.42.42.5(pid=16198): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] 02:54:16.205805 run osmo-stp_10.42.42.5(pid=16198): stdout: | (launched: 2022-12-10_02:54:14.693173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:16.370484 run osmo-stp_10.42.42.5(pid=16198): stderr: | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025414865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:16.509402 run osmo-stp_10.42.42.5(pid=16198): stdout: | (launched: 2022-12-10_02:54:14.693173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:16.641836 run osmo-stp_10.42.42.5(pid=16198): stderr: | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025414864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025414865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025414865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:16.798147 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16198): Process ended prematurely: osmo-stp_10.42.42.5(pid=16198) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:54:16.809577 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:54:16.839202 run osmo-hlr_10.42.42.2(pid=16195): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16195)] 02:54:16.890766 run osmo-hlr_10.42.42.2(pid=16195): stdout: | (launched: 2022-12-10_02:54:13.734571) 02:54:16.943826 run osmo-hlr_10.42.42.2(pid=16195): stderr: | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025413913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025413925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025413933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025413933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025413933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:17.018761 run osmo-msc_10.42.42.6(pid=16201): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16201)] 02:54:17.071090 run osmo-msc_10.42.42.6(pid=16201): stdout: | (launched: 2022-12-10_02:54:15.659991) 02:54:17.124995 run osmo-msc_10.42.42.6(pid=16201): stderr: | [0;m[38;5;43m20221210025416007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025416007 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae136a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025416007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025416007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025416008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025416008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025416014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025416015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025416015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025416015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:17.178196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Terminating (SIGTERM) 02:54:17.222124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Terminating (SIGTERM) 02:54:17.266578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16200): Terminating (SIGTERM) 02:54:17.310943 --- ParallelTerminationStrategy: PID 16194 died... 02:54:17.331320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16194): Terminated: ok {rc=0} 02:54:17.377276 --- ParallelTerminationStrategy: PID 16197 died... 02:54:17.396718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16197): Terminated: ok {rc=0} 02:54:17.443240 --- ParallelTerminationStrategy: PID 16200 died... 02:54:17.462889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16200): Terminated: ok {rc=0} 02:54:17.550955 bus /sierra_3: Setting Powered False 02:54:18.650822 bus /sierra_3: Setting Powered False 02:54:19.766283 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:54:20.916184 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:20.928291 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:54:20.999456 tst mo_mt_call_osmux.py: using LAC 25491 02:54:21.128396 tst mo_mt_call_osmux.py: using RAC 246 02:54:21.255798 tst mo_mt_call_osmux.py: using CellId 25491 02:54:21.381647 tst mo_mt_call_osmux.py: using BVCI 25492 02:54:21.500630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:21.512130 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:21.523478 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:21.534712 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:21.546150 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:21.557479 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:21.677121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:21.794793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:22.262181 run create_hlr_db(pid=16203): Launched 02:54:22.378949 bus /sierra_2: Setting Powered False 02:54:23.439603 run create_hlr_db(pid=16203): Terminated: ok {rc=0} 02:54:23.881080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16205): Launched 02:54:24.204474 run osmo-hlr_10.42.42.2(pid=16206): Launched 02:54:24.327789 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:24.883615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16208): Launched 02:54:25.205952 run osmo-stp_10.42.42.5(pid=16209): Launched 02:54:25.329657 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:25.915036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16211): Launched 02:54:26.238014 run osmo-msc_10.42.42.6(pid=16212): Launched 02:54:26.419069 run osmo-stp_10.42.42.5(pid=16209): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16209)] 02:54:26.554969 run osmo-stp_10.42.42.5(pid=16209): stdout: | (launched: 2022-12-10_02:54:25.147252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:26.690748 run osmo-stp_10.42.42.5(pid=16209): stderr: | [0;m[38;5;43m20221210025425340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025425341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025425341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025425341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:26.826055 run osmo-stp_10.42.42.5(pid=16209): stdout: | (launched: 2022-12-10_02:54:25.147252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:26.953730 run osmo-stp_10.42.42.5(pid=16209): stderr: | [0;m[38;5;43m20221210025425340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025425341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025425341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025425341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025425342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:27.106431 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16209): Process ended prematurely: osmo-stp_10.42.42.5(pid=16209) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16209)] [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:54:27.115845 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:54:27.143439 run osmo-hlr_10.42.42.2(pid=16206): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16206)] 02:54:27.193109 run osmo-hlr_10.42.42.2(pid=16206): stdout: | (launched: 2022-12-10_02:54:24.146001) 02:54:27.244327 run osmo-hlr_10.42.42.2(pid=16206): stderr: | [0;m[1;31m20221210025424343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025424343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025424343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025424344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025424344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025424344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025424357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025424365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025424365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025424366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:27.315967 run osmo-msc_10.42.42.6(pid=16212): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16212)] 02:54:27.366014 run osmo-msc_10.42.42.6(pid=16212): stdout: | (launched: 2022-12-10_02:54:26.179296) 02:54:27.417804 run osmo-msc_10.42.42.6(pid=16212): stderr: | [0;m[38;5;43m20221210025426498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025426498 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b9a369c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025426498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025426498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025426499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025426499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025426500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025426501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025426501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025426501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:27.469739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16205): Terminating (SIGTERM) 02:54:27.511028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16208): Terminating (SIGTERM) 02:54:27.552323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16211): Terminating (SIGTERM) 02:54:27.594029 --- ParallelTerminationStrategy: PID 16205 died... 02:54:27.613933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16205): Terminated: ok {rc=0} 02:54:27.659551 --- ParallelTerminationStrategy: PID 16208 died... 02:54:27.678901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16208): Terminated: ok {rc=0} 02:54:27.724609 --- ParallelTerminationStrategy: PID 16211 died... 02:54:27.743977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16211): Terminated: ok {rc=0} 02:54:27.830347 bus /sierra_3: Setting Powered False 02:54:28.929326 bus /sierra_3: Setting Powered False 02:54:30.045414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:54:31.318706 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:31.326630 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:54:31.363697 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:54:31.392614 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:54:31.446355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:54:31.488283 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:54:31.523301 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:54:32.077220 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:54:32.130653 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.142704 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:54:32.216283 tst mo_mt_call.py: using LAC 25492 02:54:32.340728 tst mo_mt_call.py: using RAC 247 02:54:32.468555 tst mo_mt_call.py: using CellId 25492 02:54:32.594280 tst mo_mt_call.py: using BVCI 25493 02:54:32.713787 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.725561 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.737103 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.749340 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.761539 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:32.773380 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:32.891861 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:33.011756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:33.515381 run create_hlr_db(pid=16217): Launched 02:54:33.648059 bus /sierra_2: Setting Powered False 02:54:34.712169 run create_hlr_db(pid=16217): Terminated: ok {rc=0} 02:54:35.144823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16219): Launched 02:54:35.449249 run osmo-hlr_10.42.42.2(pid=16220): Launched 02:54:35.566189 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:36.102860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16222): Launched 02:54:36.405962 run osmo-stp_10.42.42.5(pid=16223): Launched 02:54:36.522804 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:37.071962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16225): Launched 02:54:37.376119 run osmo-msc_10.42.42.6(pid=16226): Launched 02:54:37.548626 run osmo-stp_10.42.42.5(pid=16223): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16223)] 02:54:37.679413 run osmo-stp_10.42.42.5(pid=16223): stdout: | (launched: 2022-12-10_02:54:36.350146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:37.809140 run osmo-stp_10.42.42.5(pid=16223): stderr: | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025436520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:37.936057 run osmo-stp_10.42.42.5(pid=16223): stdout: | (launched: 2022-12-10_02:54:36.350146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:38.056570 run osmo-stp_10.42.42.5(pid=16223): stderr: | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025436519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025436520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025436520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:38.201294 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16223): Process ended prematurely: osmo-stp_10.42.42.5(pid=16223) [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16223)] [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:54:38.210170 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:54:38.236921 run osmo-hlr_10.42.42.2(pid=16220): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16220)] 02:54:38.284765 run osmo-hlr_10.42.42.2(pid=16220): stdout: | (launched: 2022-12-10_02:54:35.393915) 02:54:38.334310 run osmo-hlr_10.42.42.2(pid=16220): stderr: | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025435568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025435580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025435588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025435588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025435588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:38.403474 run osmo-msc_10.42.42.6(pid=16226): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16226)] 02:54:38.451773 run osmo-msc_10.42.42.6(pid=16226): stdout: | (launched: 2022-12-10_02:54:37.320323) 02:54:38.501249 run osmo-msc_10.42.42.6(pid=16226): stderr: | [0;m[38;5;43m20221210025437592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025437592 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb815abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025437592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025437592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025437592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025437592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025437594 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025437595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025437595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025437595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:38.551154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16219): Terminating (SIGTERM) 02:54:38.590952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16222): Terminating (SIGTERM) 02:54:38.631004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16225): Terminating (SIGTERM) 02:54:38.671019 --- ParallelTerminationStrategy: PID 16219 died... 02:54:38.689986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16219): Terminated: ok {rc=0} 02:54:38.734243 --- ParallelTerminationStrategy: PID 16222 died... 02:54:38.752687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16222): Terminated: ok {rc=0} 02:54:38.796893 --- ParallelTerminationStrategy: PID 16225 died... 02:54:38.815864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16225): Terminated: ok {rc=0} 02:54:38.903189 bus /sierra_3: Setting Powered False 02:54:40.002108 bus /sierra_3: Setting Powered False 02:54:41.113942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:54:42.263767 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.275959 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:54:42.352589 tst mo_mt_call_osmux.py: using LAC 25493 02:54:42.480453 tst mo_mt_call_osmux.py: using RAC 248 02:54:42.605900 tst mo_mt_call_osmux.py: using CellId 25493 02:54:42.729284 tst mo_mt_call_osmux.py: using BVCI 25494 02:54:42.840295 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.851729 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.863014 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.874462 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.885915 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:42.897383 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:43.018645 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:43.139111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:43.641551 run create_hlr_db(pid=16228): Launched 02:54:43.774543 bus /sierra_2: Setting Powered False 02:54:44.838213 run create_hlr_db(pid=16228): Terminated: ok {rc=0} 02:54:45.287956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16230): Launched 02:54:45.612326 run osmo-hlr_10.42.42.2(pid=16231): Launched 02:54:45.735295 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:46.327142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16233): Launched 02:54:46.724776 run osmo-stp_10.42.42.5(pid=16234): Launched 02:54:46.987424 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:47.693738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16236): Launched 02:54:48.018119 run osmo-msc_10.42.42.6(pid=16237): Launched 02:54:48.199028 run osmo-stp_10.42.42.5(pid=16234): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16234)] 02:54:48.334743 run osmo-stp_10.42.42.5(pid=16234): stdout: | (launched: 2022-12-10_02:54:46.666789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:48.472317 run osmo-stp_10.42.42.5(pid=16234): stderr: | [0;m[38;5;43m20221210025446935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025446936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025446936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025446936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:48.608432 run osmo-stp_10.42.42.5(pid=16234): stdout: | (launched: 2022-12-10_02:54:46.666789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:48.736908 run osmo-stp_10.42.42.5(pid=16234): stderr: | [0;m[38;5;43m20221210025446935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025446936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025446936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025446936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025446945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:48.891174 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16234): Process ended prematurely: osmo-stp_10.42.42.5(pid=16234) [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16234)] [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:54:48.900329 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 02:54:48.928004 run osmo-hlr_10.42.42.2(pid=16231): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16231)] 02:54:48.977632 run osmo-hlr_10.42.42.2(pid=16231): stdout: | (launched: 2022-12-10_02:54:45.552858) 02:54:49.029247 run osmo-hlr_10.42.42.2(pid=16231): stderr: | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025445751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025445763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025445772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025445772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025445772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:49.100905 run osmo-msc_10.42.42.6(pid=16237): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16237)] 02:54:49.150764 run osmo-msc_10.42.42.6(pid=16237): stdout: | (launched: 2022-12-10_02:54:47.958946) 02:54:49.202220 run osmo-msc_10.42.42.6(pid=16237): stderr: | [0;m[38;5;43m20221210025448280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025448281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff5fb657c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025448281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025448281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025448281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025448281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025448283 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025448283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025448283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025448283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:49.254122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16230): Terminating (SIGTERM) 02:54:49.295644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16233): Terminating (SIGTERM) 02:54:49.337462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16236): Terminating (SIGTERM) 02:54:49.379419 --- ParallelTerminationStrategy: PID 16230 died... 02:54:49.399369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16230): Terminated: ok {rc=0} 02:54:49.445701 --- ParallelTerminationStrategy: PID 16233 died... 02:54:49.464920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16233): Terminated: ok {rc=0} 02:54:49.510727 --- ParallelTerminationStrategy: PID 16236 died... 02:54:49.530135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16236): Terminated: ok {rc=0} 02:54:49.617470 bus /sierra_3: Setting Powered False 02:54:50.716014 bus /sierra_3: Setting Powered False 02:54:51.831117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:54:53.079289 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:53.085016 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:54:53.118616 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:54:53.145308 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:54:53.198866 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:54:53.232818 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:54:53.260167 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:54:53.805508 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:54:53.858302 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:53.869822 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:54:53.941391 tst mo_mt_call.py: using LAC 25494 02:54:54.059208 tst mo_mt_call.py: using RAC 249 02:54:54.185685 tst mo_mt_call.py: using CellId 25494 02:54:54.311605 tst mo_mt_call.py: using BVCI 25495 02:54:54.429585 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:54.441110 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:54.452060 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:54.463335 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:54.474638 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:54.485789 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:54:54.606340 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:54:54.726040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:55.227152 run create_hlr_db(pid=16242): Launched 02:54:55.358234 bus /sierra_2: Setting Powered False 02:54:56.422225 run create_hlr_db(pid=16242): Terminated: ok {rc=0} 02:54:56.853269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16244): Launched 02:54:57.157337 run osmo-hlr_10.42.42.2(pid=16245): Launched 02:54:57.273908 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:57.811937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16247): Launched 02:54:58.115438 run osmo-stp_10.42.42.5(pid=16248): Launched 02:54:58.234896 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:58.784603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16250): Launched 02:54:59.089090 run osmo-msc_10.42.42.6(pid=16251): Launched 02:54:59.260159 run osmo-stp_10.42.42.5(pid=16248): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16248)] 02:54:59.390030 run osmo-stp_10.42.42.5(pid=16248): stdout: | (launched: 2022-12-10_02:54:58.059136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:59.519286 run osmo-stp_10.42.42.5(pid=16248): stderr: | [0;m[38;5;43m20221210025458230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025458231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025458231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025458231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:59.645883 run osmo-stp_10.42.42.5(pid=16248): stdout: | (launched: 2022-12-10_02:54:58.059136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:59.766481 run osmo-stp_10.42.42.5(pid=16248): stderr: | [0;m[38;5;43m20221210025458230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025458231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025458231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025458231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025458232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:59.911259 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16248): Process ended prematurely: osmo-stp_10.42.42.5(pid=16248) [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16248)] [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:54:59.920220 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:54:59.946826 run osmo-hlr_10.42.42.2(pid=16245): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16245)] 02:54:59.994561 run osmo-hlr_10.42.42.2(pid=16245): stdout: | (launched: 2022-12-10_02:54:57.101430) 02:55:00.043804 run osmo-hlr_10.42.42.2(pid=16245): stderr: | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025457279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025457291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025457300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025457300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025457300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:00.112491 run osmo-msc_10.42.42.6(pid=16251): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16251)] 02:55:00.160169 run osmo-msc_10.42.42.6(pid=16251): stdout: | (launched: 2022-12-10_02:54:59.033199) 02:55:00.209415 run osmo-msc_10.42.42.6(pid=16251): stderr: | [0;m[38;5;43m20221210025459307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025459307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7face1cc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025459307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025459307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025459308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025459308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025459309 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025459310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025459310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025459310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:00.258851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16244): Terminating (SIGTERM) 02:55:00.298503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16247): Terminating (SIGTERM) 02:55:00.338395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16250): Terminating (SIGTERM) 02:55:00.378319 --- ParallelTerminationStrategy: PID 16244 died... 02:55:00.397305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16244): Terminated: ok {rc=0} 02:55:00.441770 --- ParallelTerminationStrategy: PID 16247 died... 02:55:00.460279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16247): Terminated: ok {rc=0} 02:55:00.504264 --- ParallelTerminationStrategy: PID 16250 died... 02:55:00.522845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16250): Terminated: ok {rc=0} 02:55:00.609076 bus /sierra_3: Setting Powered False 02:55:01.710508 bus /sierra_3: Setting Powered False 02:55:02.829695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:55:03.976234 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:03.987836 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:55:04.058644 tst mo_mt_call_osmux.py: using LAC 25495 02:55:04.179065 tst mo_mt_call_osmux.py: using RAC 250 02:55:04.299440 tst mo_mt_call_osmux.py: using CellId 25495 02:55:04.419888 tst mo_mt_call_osmux.py: using BVCI 25496 02:55:04.531532 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:04.542394 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:04.552926 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:04.563886 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:04.574971 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:04.585905 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:04.702879 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:04.822625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:05.323826 run create_hlr_db(pid=16256): Launched 02:55:05.456668 bus /sierra_2: Setting Powered False 02:55:06.520691 run create_hlr_db(pid=16256): Terminated: ok {rc=0} 02:55:06.953395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16258): Launched 02:55:07.258741 run osmo-hlr_10.42.42.2(pid=16259): Launched 02:55:07.375322 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:07.900422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16261): Launched 02:55:08.203657 run osmo-stp_10.42.42.5(pid=16262): Launched 02:55:08.320182 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:08.871218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16264): Launched 02:55:09.176088 run osmo-msc_10.42.42.6(pid=16265): Launched 02:55:09.347678 run osmo-stp_10.42.42.5(pid=16262): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16262)] 02:55:09.481281 run osmo-stp_10.42.42.5(pid=16262): stdout: | (launched: 2022-12-10_02:55:08.147566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:09.610791 run osmo-stp_10.42.42.5(pid=16262): stderr: | [0;m[38;5;43m20221210025508318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025508318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025508319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025508319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:09.737816 run osmo-stp_10.42.42.5(pid=16262): stdout: | (launched: 2022-12-10_02:55:08.147566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:09.857719 run osmo-stp_10.42.42.5(pid=16262): stderr: | [0;m[38;5;43m20221210025508318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025508318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025508319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025508319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025508320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:10.002401 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16262): Process ended prematurely: osmo-stp_10.42.42.5(pid=16262) [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16262)] [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:55:10.011240 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:55:10.038510 run osmo-hlr_10.42.42.2(pid=16259): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16259)] 02:55:10.086728 run osmo-hlr_10.42.42.2(pid=16259): stdout: | (launched: 2022-12-10_02:55:07.203184) 02:55:10.136540 run osmo-hlr_10.42.42.2(pid=16259): stderr: | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025507380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025507392 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025507402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025507402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025507402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:10.206444 run osmo-msc_10.42.42.6(pid=16265): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16265)] 02:55:10.254703 run osmo-msc_10.42.42.6(pid=16265): stdout: | (launched: 2022-12-10_02:55:09.120159) 02:55:10.304570 run osmo-msc_10.42.42.6(pid=16265): stderr: | [0;m[38;5;43m20221210025509393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025509393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f845c180c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025509393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025509393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025509394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025509394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025509395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025509396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025509396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025509397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:10.355265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16258): Terminating (SIGTERM) 02:55:10.395684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16261): Terminating (SIGTERM) 02:55:10.435976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16264): Terminating (SIGTERM) 02:55:10.476765 --- ParallelTerminationStrategy: PID 16258 died... 02:55:10.496168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16258): Terminated: ok {rc=0} 02:55:10.541550 --- ParallelTerminationStrategy: PID 16261 died... 02:55:10.560310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16261): Terminated: ok {rc=0} 02:55:10.605347 --- ParallelTerminationStrategy: PID 16264 died... 02:55:10.624136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16264): Terminated: ok {rc=0} 02:55:10.709332 bus /sierra_3: Setting Powered False 02:55:11.808272 bus /sierra_3: Setting Powered False 02:55:12.926411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:trx-lms --------------------------------------------------------------------- 02:55:14.177566 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:14.182334 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 02:55:14.216016 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:55:14.243476 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 02:55:14.330260 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 02:55:14.364002 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:55:14.391664 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 02:55:14.972280 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 02:55:14.978325 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:14.989939 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:55:15.041750 tst emergency_mo_mt_call.py: using LAC 25496 02:55:15.167049 tst emergency_mo_mt_call.py: using RAC 251 02:55:15.290483 tst emergency_mo_mt_call.py: using CellId 25496 02:55:15.414328 tst emergency_mo_mt_call.py: using BVCI 25497 02:55:15.531036 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:15.542159 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:15.553023 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:15.564190 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:15.575120 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:15.586053 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:15.705476 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:15.827520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:16.326807 run create_hlr_db(pid=16270): Launched 02:55:16.500882 bus /sierra_2: Setting Powered False 02:55:17.559856 run create_hlr_db(pid=16270): Terminated: ok {rc=0} 02:55:17.999410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16272): Launched 02:55:18.317620 run osmo-hlr_10.42.42.2(pid=16273): Launched 02:55:18.440336 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:18.993610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16275): Launched 02:55:19.311185 run osmo-stp_10.42.42.5(pid=16276): Launched 02:55:19.441596 tst emergency_mo_mt_call.py: using MSISDN 7512 02:55:19.604596 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:20.175381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16278): Launched 02:55:20.494823 run osmo-msc_10.42.42.6(pid=16279): Launched 02:55:20.673119 run osmo-stp_10.42.42.5(pid=16276): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16276)] 02:55:20.807085 run osmo-stp_10.42.42.5(pid=16276): stdout: | (launched: 2022-12-10_02:55:19.253426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:20.941790 run osmo-stp_10.42.42.5(pid=16276): stderr: | [0;m[38;5;43m20221210025519444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025519444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025519445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025519445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:21.075505 run osmo-stp_10.42.42.5(pid=16276): stdout: | (launched: 2022-12-10_02:55:19.253426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:21.201821 run osmo-stp_10.42.42.5(pid=16276): stderr: | [0;m[38;5;43m20221210025519444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025519444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025519445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025519445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:21.352659 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16276): Process ended prematurely: osmo-stp_10.42.42.5(pid=16276) [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16276)] [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 02:55:21.361494 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 02:55:21.389165 run osmo-hlr_10.42.42.2(pid=16273): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16273)] 02:55:21.439290 run osmo-hlr_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-10_02:55:18.259519) 02:55:21.491023 run osmo-hlr_10.42.42.2(pid=16273): stderr: | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025518457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025518469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025518477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025518477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025518477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:21.563073 run osmo-msc_10.42.42.6(pid=16279): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16279)] 02:55:21.613156 run osmo-msc_10.42.42.6(pid=16279): stdout: | (launched: 2022-12-10_02:55:20.436269) 02:55:21.664374 run osmo-msc_10.42.42.6(pid=16279): stderr: | [0;m[38;5;43m20221210025520758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025520758 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa3a0955c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025520758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025520758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025520758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025520759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025520760 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025520761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025520761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025520761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:21.716056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16272): Terminating (SIGTERM) 02:55:21.757510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16275): Terminating (SIGTERM) 02:55:21.798823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16278): Terminating (SIGTERM) 02:55:21.840538 --- ParallelTerminationStrategy: PID 16272 died... 02:55:21.860483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16272): Terminated: ok {rc=0} 02:55:21.906593 --- ParallelTerminationStrategy: PID 16275 died... 02:55:21.925952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16275): Terminated: ok {rc=0} 02:55:21.971573 --- ParallelTerminationStrategy: PID 16278 died... 02:55:21.991116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16278): Terminated: ok {rc=0} 02:55:22.078788 bus /sierra_3: Setting Powered False 02:55:23.178392 bus /sierra_3: Setting Powered False 02:55:24.296262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 02:55:25.383617 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.395325 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:55:25.450349 tst emergency_preemptive_call.py: using LAC 25497 02:55:25.574703 tst emergency_preemptive_call.py: using RAC 252 02:55:25.697265 tst emergency_preemptive_call.py: using CellId 25497 02:55:25.822568 tst emergency_preemptive_call.py: using BVCI 25498 02:55:25.937179 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.948229 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.959205 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.970184 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.981082 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:25.991935 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:26.106599 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:26.225845 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:26.341687 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:26.460162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:26.952757 run create_hlr_db(pid=16281): Launched 02:55:27.081852 bus /sierra_2: Setting Powered False 02:55:28.144928 run create_hlr_db(pid=16281): Terminated: ok {rc=0} 02:55:28.570086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Launched 02:55:28.868252 run osmo-hlr_10.42.42.2(pid=16284): Launched 02:55:28.982410 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:29.494718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Launched 02:55:29.792759 run osmo-stp_10.42.42.5(pid=16287): Launched 02:55:29.917422 tst emergency_preemptive_call.py: using MSISDN 7513 02:55:30.069485 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:30.602010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Launched 02:55:30.919424 run osmo-msc_10.42.42.6(pid=16290): Launched 02:55:31.208578 run osmo-stp_10.42.42.5(pid=16287): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] 02:55:31.409879 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-10_02:55:29.738007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:31.733352 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025529909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025529909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025529910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025529911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:31.863662 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-10_02:55:29.738007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:31.986678 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025529908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025529909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025529909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025529910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025529911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:32.133526 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py:32] 02:55:32.142761 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 02:55:32.172604 run osmo-hlr_10.42.42.2(pid=16284): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16284)] 02:55:32.223490 run osmo-hlr_10.42.42.2(pid=16284): stdout: | (launched: 2022-12-10_02:55:28.813521) 02:55:32.275907 run osmo-hlr_10.42.42.2(pid=16284): stderr: | [0;m[1;31m20221210025528988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025528988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025528989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025528989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025528989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025528989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025529003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025529014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025529015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025529015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:32.347937 run osmo-msc_10.42.42.6(pid=16290): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16290)] 02:55:32.399331 run osmo-msc_10.42.42.6(pid=16290): stdout: | (launched: 2022-12-10_02:55:30.851049) 02:55:32.450160 run osmo-msc_10.42.42.6(pid=16290): stderr: | [0;m[38;5;43m20221210025531471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210025531472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b01bc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210025531472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210025531472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210025531472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210025531472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210025531474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210025531474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210025531475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210025531475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:32.501128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminating (SIGTERM) 02:55:32.541236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminating (SIGTERM) 02:55:32.581491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Terminating (SIGTERM) 02:55:32.622702 --- ParallelTerminationStrategy: PID 16283 died... 02:55:32.642473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminated: ok {rc=0} 02:55:32.687214 --- ParallelTerminationStrategy: PID 16286 died... 02:55:32.706194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminated: ok {rc=0} 02:55:32.750895 --- ParallelTerminationStrategy: PID 16289 died... 02:55:32.769818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Terminated: ok {rc=0} 02:55:32.854654 bus /sierra_9: Setting Powered False 02:55:33.951630 bus /sierra_9: Setting Powered False 02:55:35.067563 bus /sierra_8: Setting Powered False 02:55:36.166320 bus /sierra_8: Setting Powered False 02:55:37.282336 bus /sierra_3: Setting Powered False 02:55:38.381308 bus /sierra_3: Setting Powered False 02:55:39.500495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms --------------------------------------------------------------------- 02:55:40.776291 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:40.780428 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 02:55:40.813926 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 02:55:40.852200 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 02:55:40.937917 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 02:55:40.970584 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 02:55:41.008823 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 02:55:41.598054 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 02:55:41.647699 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:41.658217 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:55:41.706416 tst cs_paging_gprs_active.py: using LAC 25498 02:55:41.827402 tst cs_paging_gprs_active.py: using RAC 253 02:55:41.947638 tst cs_paging_gprs_active.py: using CellId 25498 02:55:42.068380 tst cs_paging_gprs_active.py: using BVCI 25499 02:55:42.180088 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.190718 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.201070 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.211643 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.222564 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.233052 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.243762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.254257 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:42.264891 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:55:42.385481 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:55:42.506055 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:55:42.724748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:55:43.049887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Launched 02:55:43.332217 run iperf3-srv_10.42.42.10(pid=16297): Launched 02:55:43.455718 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:55:43.673899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:55:43.999634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Launched 02:55:44.282506 run iperf3-srv_10.42.42.10(pid=16299): Launched 02:55:44.405359 tst cs_paging_gprs_active.py:38: start network... 02:55:44.623969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:45.126426 run create_hlr_db(pid=16300): Launched 02:55:45.259707 bus /sierra_2: Setting Powered False 02:55:46.319355 run create_hlr_db(pid=16300): Terminated: ok {rc=0} 02:55:46.766365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Launched 02:55:47.102422 run osmo-hlr_10.42.42.2(pid=16303): Launched 02:55:47.284322 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:47.843266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Launched 02:55:48.168271 run osmo-stp_10.42.42.5(pid=16306): Launched 02:55:48.291612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:55:48.857164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Launched 02:55:48.981651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:55:49.255480 run patchelf(pid=16309): Launched 02:55:49.435788 run osmo-stp_10.42.42.5(pid=16306): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] 02:55:49.573908 run osmo-stp_10.42.42.5(pid=16306): stdout: | (launched: 2022-12-10_02:55:48.108866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:49.712289 run osmo-stp_10.42.42.5(pid=16306): stderr: | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025548302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:49.851308 run osmo-stp_10.42.42.5(pid=16306): stdout: | (launched: 2022-12-10_02:55:48.108866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:49.984228 run osmo-stp_10.42.42.5(pid=16306): stderr: | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025548301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025548302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025548302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:50.142006 run patchelf(pid=16309): Terminating (SIGINT) 02:55:50.323515 run patchelf(pid=16309): Terminated: ok {rc=0} 02:55:50.454570 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16306): Process ended prematurely: osmo-stp_10.42.42.5(pid=16306) [trial-2368↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] [trial-2368↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 02:55:50.464541 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:55:50.493144 run osmo-hlr_10.42.42.2(pid=16303): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16303)] 02:55:50.543757 run osmo-hlr_10.42.42.2(pid=16303): stdout: | (launched: 2022-12-10_02:55:47.041266) 02:55:50.595693 run osmo-hlr_10.42.42.2(pid=16303): stderr: | [0;m[1;31m20221210025547303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025547303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025547304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025547304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025547304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025547304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025547316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025547324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025547325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025547325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:50.648176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Terminating (SIGTERM) 02:55:50.690108 run iperf3-srv_10.42.42.10(pid=16297): Terminating (SIGTERM) 02:55:50.731897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminating (SIGTERM) 02:55:50.774001 run iperf3-srv_10.42.42.10(pid=16299): Terminating (SIGTERM) 02:55:50.815722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Terminating (SIGTERM) 02:55:50.857601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Terminating (SIGTERM) 02:55:50.899418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Terminating (SIGTERM) 02:55:50.941527 --- ParallelTerminationStrategy: PID 16296 died... 02:55:50.961635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16296): Terminated: ok {rc=0} 02:55:51.008045 --- ParallelTerminationStrategy: PID 16297 died... 02:55:51.027752 run iperf3-srv_10.42.42.10(pid=16297): Terminated {rc=256} 02:55:51.073558 --- ParallelTerminationStrategy: PID 16298 died... 02:55:51.093170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16298): Terminated: ok {rc=0} 02:55:51.138666 --- ParallelTerminationStrategy: PID 16299 died... 02:55:51.158022 run iperf3-srv_10.42.42.10(pid=16299): Terminated {rc=256} 02:55:51.204027 --- ParallelTerminationStrategy: PID 16302 died... 02:55:51.223463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16302): Terminated: ok {rc=0} 02:55:51.269135 --- ParallelTerminationStrategy: PID 16305 died... 02:55:51.288444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16305): Terminated: ok {rc=0} 02:55:51.334144 --- ParallelTerminationStrategy: PID 16308 died... 02:55:51.353558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16308): Terminated: ok {rc=0} 02:55:51.440381 bus /gobi_0: Setting Powered False 02:55:52.539526 bus /gobi_0: Setting Powered False 02:55:53.654868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms iperf3.py ---------------------------------------------- 02:55:54.804321 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:54.815908 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:55:54.869344 tst iperf3.py: using LAC 25499 02:55:54.992864 tst iperf3.py: using RAC 254 02:55:55.113228 tst iperf3.py: using CellId 25499 02:55:55.233965 tst iperf3.py: using BVCI 25500 02:55:55.344629 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.355387 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.366090 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.376914 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.388130 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.399178 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.410243 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.421204 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:55.432092 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:55:55.552597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:55:55.771691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:55:56.096730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Launched 02:55:56.379400 run iperf3-srv_10.42.42.10(pid=16311): Launched 02:55:56.502434 tst iperf3.py:8: start network... 02:55:56.721777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:57.225715 run create_hlr_db(pid=16312): Launched 02:55:57.359193 bus /gobi_6: Setting Powered False 02:55:58.422987 run create_hlr_db(pid=16312): Terminated: ok {rc=0} 02:55:58.856589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Launched 02:55:59.162220 run osmo-hlr_10.42.42.2(pid=16315): Launched 02:55:59.278866 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:59.818606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Launched 02:56:00.122094 run osmo-stp_10.42.42.5(pid=16318): Launched 02:56:00.238396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:00.761731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Launched 02:56:00.886922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:01.181739 run patchelf(pid=16321): Launched 02:56:01.379832 run osmo-stp_10.42.42.5(pid=16318): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] 02:56:01.521152 run osmo-stp_10.42.42.5(pid=16318): stdout: | (launched: 2022-12-10_02:56:00.066524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:01.665022 run osmo-stp_10.42.42.5(pid=16318): stderr: | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025600239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:01.807062 run osmo-stp_10.42.42.5(pid=16318): stdout: | (launched: 2022-12-10_02:56:00.066524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:01.944780 run osmo-stp_10.42.42.5(pid=16318): stderr: | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025600238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025600239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025600239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:02.107178 run patchelf(pid=16321): Terminating (SIGINT) 02:56:02.291799 run patchelf(pid=16321): Terminated: ok {rc=0} 02:56:02.423118 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16318): Process ended prematurely: osmo-stp_10.42.42.5(pid=16318) [trial-2368↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] [trial-2368↪gprs:trx-lms↪iperf3.py:8] 02:56:02.433116 tst iperf3.py:8: Test FAILED (7.7 sec) 02:56:02.462274 run osmo-hlr_10.42.42.2(pid=16315): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16315)] 02:56:02.512832 run osmo-hlr_10.42.42.2(pid=16315): stdout: | (launched: 2022-12-10_02:55:59.106123) 02:56:02.565713 run osmo-hlr_10.42.42.2(pid=16315): stderr: | [0;m[1;31m20221210025559282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025559282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025559282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025559282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025559282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025559283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025559294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025559303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025559303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025559303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:02.618701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Terminating (SIGTERM) 02:56:02.660743 run iperf3-srv_10.42.42.10(pid=16311): Terminating (SIGTERM) 02:56:02.702561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Terminating (SIGTERM) 02:56:02.744402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Terminating (SIGTERM) 02:56:02.786203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Terminating (SIGTERM) 02:56:02.828270 --- ParallelTerminationStrategy: PID 16310 died... 02:56:02.848367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16310): Terminated: ok {rc=0} 02:56:02.894867 --- ParallelTerminationStrategy: PID 16311 died... 02:56:02.914542 run iperf3-srv_10.42.42.10(pid=16311): Terminated {rc=256} 02:56:02.960512 --- ParallelTerminationStrategy: PID 16314 died... 02:56:02.980134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16314): Terminated: ok {rc=0} 02:56:03.026266 --- ParallelTerminationStrategy: PID 16317 died... 02:56:03.045933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16317): Terminated: ok {rc=0} 02:56:03.092309 --- ParallelTerminationStrategy: PID 16320 died... 02:56:03.112170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16320): Terminated: ok {rc=0} 02:56:03.199315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms iperf3m4.py ---------------------------------------------- 02:56:04.350994 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.363171 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:04.413637 tst iperf3m4.py: using LAC 25500 02:56:04.543090 tst iperf3m4.py: using RAC 255 02:56:04.672128 tst iperf3m4.py: using CellId 25500 02:56:04.794572 tst iperf3m4.py: using BVCI 25501 02:56:04.907600 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.918413 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.928942 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.940411 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.951642 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.963025 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.974390 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.985553 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:04.997097 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:05.120357 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:05.247090 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:05.362373 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:05.481475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:05.702216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:06.026722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16322): Launched 02:56:06.309115 run iperf3-srv_10.42.42.10(pid=16323): Launched 02:56:06.431137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:56:06.649817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:06.974846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16324): Launched 02:56:07.257416 run iperf3-srv_10.42.42.10(pid=16325): Launched 02:56:07.379936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:56:07.599343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:07.924859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16326): Launched 02:56:08.206448 run iperf3-srv_10.42.42.10(pid=16327): Launched 02:56:08.328586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:56:08.546928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:08.872117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16328): Launched 02:56:09.154221 run iperf3-srv_10.42.42.10(pid=16329): Launched 02:56:09.275958 tst iperf3m4.py:8: start network... 02:56:09.494244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:09.998719 run create_hlr_db(pid=16330): Launched 02:56:10.131164 bus /gobi_6: Setting Powered False 02:56:11.195619 run create_hlr_db(pid=16330): Terminated: ok {rc=0} 02:56:11.628424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16332): Launched 02:56:11.933787 run osmo-hlr_10.42.42.2(pid=16333): Launched 02:56:12.049945 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:12.585198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16335): Launched 02:56:12.888575 run osmo-stp_10.42.42.5(pid=16336): Launched 02:56:13.004107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:13.526583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16338): Launched 02:56:13.642876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:13.898816 run patchelf(pid=16339): Launched 02:56:14.068289 run osmo-stp_10.42.42.5(pid=16336): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16336)] 02:56:14.196757 run osmo-stp_10.42.42.5(pid=16336): stdout: | (launched: 2022-12-10_02:56:12.832926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:14.326290 run osmo-stp_10.42.42.5(pid=16336): stderr: | [0;m[38;5;43m20221210025613004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025613004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025613005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025613005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025613005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025613006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025613006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:14.455918 run osmo-stp_10.42.42.5(pid=16336): stdout: | (launched: 2022-12-10_02:56:12.832926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:14.580477 run osmo-stp_10.42.42.5(pid=16336): stderr: | [0;m[38;5;43m20221210025613004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025613004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025613005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025613005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025613005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025613006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025613006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:14.728568 run patchelf(pid=16339): Terminating (SIGINT) 02:56:14.899235 run patchelf(pid=16339): Terminated: ok {rc=0} 02:56:15.021490 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16336): Process ended prematurely: osmo-stp_10.42.42.5(pid=16336) [trial-2368↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16336)] [trial-2368↪gprs:trx-lms↪iperf3m4.py:8] 02:56:15.030804 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:56:15.059015 run osmo-hlr_10.42.42.2(pid=16333): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16333)] 02:56:15.107063 run osmo-hlr_10.42.42.2(pid=16333): stdout: | (launched: 2022-12-10_02:56:11.877928) 02:56:15.157633 run osmo-hlr_10.42.42.2(pid=16333): stderr: | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025612056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025612068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025612077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025612078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025612078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:15.207945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16322): Terminating (SIGTERM) 02:56:15.248199 run iperf3-srv_10.42.42.10(pid=16323): Terminating (SIGTERM) 02:56:15.288273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16324): Terminating (SIGTERM) 02:56:15.328444 run iperf3-srv_10.42.42.10(pid=16325): Terminating (SIGTERM) 02:56:15.368603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16326): Terminating (SIGTERM) 02:56:15.408721 run iperf3-srv_10.42.42.10(pid=16327): Terminating (SIGTERM) 02:56:15.448839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16328): Terminating (SIGTERM) 02:56:15.489547 run iperf3-srv_10.42.42.10(pid=16329): Terminating (SIGTERM) 02:56:15.531577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16332): Terminating (SIGTERM) 02:56:15.572215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16335): Terminating (SIGTERM) 02:56:15.612196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16338): Terminating (SIGTERM) 02:56:15.652097 --- ParallelTerminationStrategy: PID 16322 died... 02:56:15.671187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16322): Terminated: ok {rc=0} 02:56:15.715893 --- ParallelTerminationStrategy: PID 16323 died... 02:56:15.734851 run iperf3-srv_10.42.42.10(pid=16323): Terminated {rc=256} 02:56:15.779670 --- ParallelTerminationStrategy: PID 16324 died... 02:56:15.798523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16324): Terminated: ok {rc=0} 02:56:15.850246 --- ParallelTerminationStrategy: PID 16325 died... 02:56:15.879683 run iperf3-srv_10.42.42.10(pid=16325): Terminated {rc=256} 02:56:15.932351 --- ParallelTerminationStrategy: PID 16326 died... 02:56:15.951779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16326): Terminated: ok {rc=0} 02:56:15.997584 --- ParallelTerminationStrategy: PID 16327 died... 02:56:16.017720 run iperf3-srv_10.42.42.10(pid=16327): Terminated {rc=256} 02:56:16.074052 --- ParallelTerminationStrategy: PID 16328 died... 02:56:16.097557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16328): Terminated: ok {rc=0} 02:56:16.152719 --- ParallelTerminationStrategy: PID 16329 died... 02:56:16.177483 run iperf3-srv_10.42.42.10(pid=16329): Terminated {rc=256} 02:56:16.232021 --- ParallelTerminationStrategy: PID 16332 died... 02:56:16.256177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16332): Terminated: ok {rc=0} 02:56:16.312145 --- ParallelTerminationStrategy: PID 16335 died... 02:56:16.336573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16335): Terminated: ok {rc=0} 02:56:16.392703 --- ParallelTerminationStrategy: PID 16338 died... 02:56:16.416126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16338): Terminated: ok {rc=0} 02:56:16.519876 bus /gobi_4: Setting Powered False 02:56:17.628895 bus /gobi_4: Setting Powered False 02:56:18.746567 bus /gobi_1: Setting Powered False 02:56:19.844886 bus /gobi_1: Setting Powered False 02:56:20.963507 bus /gobi_0: Setting Powered False 02:56:22.061042 bus /gobi_0: Setting Powered False 02:56:23.177975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms ping.py ---------------------------------------------- 02:56:24.281783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.292663 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:24.343041 tst ping.py: using LAC 25501 02:56:24.465428 tst ping.py: using RAC 1 02:56:24.581614 tst ping.py: using CellId 25501 02:56:24.707382 tst ping.py: using BVCI 25502 02:56:24.823687 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.834841 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.845903 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.857480 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.869296 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.881372 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.892232 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:24.903562 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:25.019729 tst ping.py:19: start network... 02:56:25.218925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:25.677814 run create_hlr_db(pid=16340): Launched 02:56:25.792079 bus /gobi_6: Setting Powered False 02:56:26.852307 run create_hlr_db(pid=16340): Terminated: ok {rc=0} 02:56:27.287194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Launched 02:56:27.606188 run osmo-hlr_10.42.42.2(pid=16343): Launched 02:56:27.727786 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:28.282572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Launched 02:56:28.601214 run osmo-stp_10.42.42.5(pid=16346): Launched 02:56:28.723038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:29.275865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16348): Launched 02:56:29.398533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:29.668175 run patchelf(pid=16349): Launched 02:56:29.846833 run osmo-stp_10.42.42.5(pid=16346): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] 02:56:29.982042 run osmo-stp_10.42.42.5(pid=16346): stdout: | (launched: 2022-12-10_02:56:28.543309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:30.118991 run osmo-stp_10.42.42.5(pid=16346): stderr: | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025628738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:30.256023 run osmo-stp_10.42.42.5(pid=16346): stdout: | (launched: 2022-12-10_02:56:28.543309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:30.387084 run osmo-stp_10.42.42.5(pid=16346): stderr: | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025628737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025628738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025628738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:30.543465 run patchelf(pid=16349): Terminating (SIGINT) 02:56:30.722711 run patchelf(pid=16349): Terminated: ok {rc=0} 02:56:30.856383 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16346): Process ended prematurely: osmo-stp_10.42.42.5(pid=16346) [trial-2368↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] [trial-2368↪gprs:trx-lms↪ping.py:22] 02:56:30.870104 tst ping.py:22: Test FAILED (6.6 sec) 02:56:30.903482 run osmo-hlr_10.42.42.2(pid=16343): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16343)] 02:56:30.959304 run osmo-hlr_10.42.42.2(pid=16343): stdout: | (launched: 2022-12-10_02:56:27.548152) 02:56:31.012675 run osmo-hlr_10.42.42.2(pid=16343): stderr: | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025627745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025627758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025627766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025627767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025627767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:31.075452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Terminating (SIGTERM) 02:56:31.118829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Terminating (SIGTERM) 02:56:31.162469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16348): Terminating (SIGTERM) 02:56:31.206363 --- ParallelTerminationStrategy: PID 16342 died... 02:56:31.227247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Terminated: ok {rc=0} 02:56:31.275530 --- ParallelTerminationStrategy: PID 16345 died... 02:56:31.298555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Terminated: ok {rc=0} 02:56:31.346561 --- ParallelTerminationStrategy: PID 16348 died... 02:56:31.366884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16348): Terminated: ok {rc=0} 02:56:31.456568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 02:56:32.546104 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:32.557845 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:32.617480 tst ping_idle_ping.py: using LAC 25502 02:56:32.737351 tst ping_idle_ping.py: using RAC 2 02:56:32.855714 tst ping_idle_ping.py: using CellId 25502 02:56:32.972209 tst ping_idle_ping.py: using BVCI 25503 02:56:33.081150 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.091837 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.102677 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.113714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.124678 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.135697 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.146773 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:33.157917 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:33.277129 tst ping_idle_ping.py:24: start network... 02:56:33.493061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:33.990252 run create_hlr_db(pid=16350): Launched 02:56:34.120753 bus /gobi_6: Setting Powered False 02:56:35.184534 run create_hlr_db(pid=16350): Terminated: ok {rc=0} 02:56:35.614258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16352): Launched 02:56:35.914930 run osmo-hlr_10.42.42.2(pid=16353): Launched 02:56:36.029287 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:36.555560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16355): Launched 02:56:36.854548 run osmo-stp_10.42.42.5(pid=16356): Launched 02:56:36.968882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:37.483408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16358): Launched 02:56:37.598694 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:37.851402 run patchelf(pid=16359): Launched 02:56:38.019153 run osmo-stp_10.42.42.5(pid=16356): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16356)] 02:56:38.146179 run osmo-stp_10.42.42.5(pid=16356): stdout: | (launched: 2022-12-10_02:56:36.799893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:38.275434 run osmo-stp_10.42.42.5(pid=16356): stderr: | [0;m[38;5;43m20221210025636968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025636968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025636969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025636969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025636971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025636971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025636972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:38.404269 run osmo-stp_10.42.42.5(pid=16356): stdout: | (launched: 2022-12-10_02:56:36.799893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:38.527606 run osmo-stp_10.42.42.5(pid=16356): stderr: | [0;m[38;5;43m20221210025636968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025636968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025636969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025636969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025636971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025636971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025636972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:38.673427 run patchelf(pid=16359): Terminating (SIGINT) 02:56:38.841775 run patchelf(pid=16359): Terminated: ok {rc=0} 02:56:38.962841 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16356): Process ended prematurely: osmo-stp_10.42.42.5(pid=16356) [trial-2368↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16356)] [trial-2368↪gprs:trx-lms↪ping_idle_ping.py:27] 02:56:38.971681 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:56:38.999072 run osmo-hlr_10.42.42.2(pid=16353): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16353)] 02:56:39.047113 run osmo-hlr_10.42.42.2(pid=16353): stdout: | (launched: 2022-12-10_02:56:35.860178) 02:56:39.097113 run osmo-hlr_10.42.42.2(pid=16353): stderr: | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025636034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025636047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025636056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025636056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025636056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:39.147305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16352): Terminating (SIGTERM) 02:56:39.187471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16355): Terminating (SIGTERM) 02:56:39.227574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16358): Terminating (SIGTERM) 02:56:39.268043 --- ParallelTerminationStrategy: PID 16352 died... 02:56:39.287345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16352): Terminated: ok {rc=0} 02:56:39.332410 --- ParallelTerminationStrategy: PID 16355 died... 02:56:39.351245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16355): Terminated: ok {rc=0} 02:56:39.395789 --- ParallelTerminationStrategy: PID 16358 died... 02:56:39.414678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16358): Terminated: ok {rc=0} 02:56:39.499242 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 02:56:40.794752 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:56:40.800069 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:56:40.833372 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:56:40.871758 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:56:40.958373 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:56:40.991230 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:56:41.029601 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:56:41.630703 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:56:41.684253 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:41.695447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:56:41.747811 tst cs_paging_gprs_active.py: using LAC 25503 02:56:41.876123 tst cs_paging_gprs_active.py: using RAC 3 02:56:42.005279 tst cs_paging_gprs_active.py: using CellId 25503 02:56:42.132890 tst cs_paging_gprs_active.py: using BVCI 25504 02:56:42.250843 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.262138 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.273176 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.284260 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.295243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.306245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.317548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.328430 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:42.339699 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:56:42.456613 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:56:42.575687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:56:42.794617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:43.121705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Launched 02:56:43.404562 run iperf3-srv_10.42.42.10(pid=16366): Launched 02:56:43.527419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:56:43.744750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:44.070094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Launched 02:56:44.352224 run iperf3-srv_10.42.42.10(pid=16368): Launched 02:56:44.475289 tst cs_paging_gprs_active.py:38: start network... 02:56:44.694057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:45.198246 run create_hlr_db(pid=16369): Launched 02:56:45.330512 bus /gobi_6: Setting Powered False 02:56:46.391874 run create_hlr_db(pid=16369): Terminated: ok {rc=0} 02:56:46.841745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16371): Launched 02:56:47.163292 run osmo-hlr_10.42.42.2(pid=16372): Launched 02:56:47.292674 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:47.821925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16374): Launched 02:56:48.126763 run osmo-stp_10.42.42.5(pid=16375): Launched 02:56:48.242772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:48.766169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16377): Launched 02:56:48.882745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:49.139297 run patchelf(pid=16378): Launched 02:56:49.310060 run osmo-stp_10.42.42.5(pid=16375): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16375)] 02:56:49.439008 run osmo-stp_10.42.42.5(pid=16375): stdout: | (launched: 2022-12-10_02:56:48.070757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:49.568634 run osmo-stp_10.42.42.5(pid=16375): stderr: | [0;m[38;5;43m20221210025648241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025648242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025648242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025648242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:49.699518 run osmo-stp_10.42.42.5(pid=16375): stdout: | (launched: 2022-12-10_02:56:48.070757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:49.825250 run osmo-stp_10.42.42.5(pid=16375): stderr: | [0;m[38;5;43m20221210025648241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025648242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025648242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025648242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025648243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:49.974076 run patchelf(pid=16378): Terminating (SIGINT) 02:56:50.144700 run patchelf(pid=16378): Terminated: ok {rc=0} 02:56:50.267773 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16375): Process ended prematurely: osmo-stp_10.42.42.5(pid=16375) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16375)] [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:56:50.277238 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:56:50.304532 run osmo-hlr_10.42.42.2(pid=16372): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16372)] 02:56:50.352584 run osmo-hlr_10.42.42.2(pid=16372): stdout: | (launched: 2022-12-10_02:56:47.102826) 02:56:50.401972 run osmo-hlr_10.42.42.2(pid=16372): stderr: | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025647295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025647307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025647316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025647316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025647316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:50.451995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminating (SIGTERM) 02:56:50.491652 run iperf3-srv_10.42.42.10(pid=16366): Terminating (SIGTERM) 02:56:50.531399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Terminating (SIGTERM) 02:56:50.571223 run iperf3-srv_10.42.42.10(pid=16368): Terminating (SIGTERM) 02:56:50.610854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16371): Terminating (SIGTERM) 02:56:50.650567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16374): Terminating (SIGTERM) 02:56:50.690167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16377): Terminating (SIGTERM) 02:56:50.730154 --- ParallelTerminationStrategy: PID 16365 died... 02:56:50.749182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16365): Terminated: ok {rc=0} 02:56:50.793433 --- ParallelTerminationStrategy: PID 16366 died... 02:56:50.811746 run iperf3-srv_10.42.42.10(pid=16366): Terminated {rc=256} 02:56:50.855751 --- ParallelTerminationStrategy: PID 16367 died... 02:56:50.874371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16367): Terminated: ok {rc=0} 02:56:50.918400 --- ParallelTerminationStrategy: PID 16368 died... 02:56:50.936835 run iperf3-srv_10.42.42.10(pid=16368): Terminated {rc=256} 02:56:50.980768 --- ParallelTerminationStrategy: PID 16371 died... 02:56:50.999620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16371): Terminated: ok {rc=0} 02:56:51.043701 --- ParallelTerminationStrategy: PID 16374 died... 02:56:51.062303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16374): Terminated: ok {rc=0} 02:56:51.106511 --- ParallelTerminationStrategy: PID 16377 died... 02:56:51.125115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16377): Terminated: ok {rc=0} 02:56:51.209132 bus /gobi_0: Setting Powered False 02:56:52.306066 bus /gobi_0: Setting Powered False 02:56:53.421122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:56:54.568762 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:54.580098 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:56:54.631920 tst iperf3.py: using LAC 25504 02:56:54.761320 tst iperf3.py: using RAC 4 02:56:54.881384 tst iperf3.py: using CellId 25504 02:56:55.001306 tst iperf3.py: using BVCI 25505 02:56:55.114484 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.125429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.136003 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.146946 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.157793 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.168446 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.179428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.190519 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:55.201513 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:56:55.321808 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:55.541207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:55.867077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Launched 02:56:56.149515 run iperf3-srv_10.42.42.10(pid=16380): Launched 02:56:56.271506 tst iperf3.py:8: start network... 02:56:56.490996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:56.994429 run create_hlr_db(pid=16381): Launched 02:56:57.126812 bus /gobi_6: Setting Powered False 02:56:58.190901 run create_hlr_db(pid=16381): Terminated: ok {rc=0} 02:56:58.625344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Launched 02:56:58.929962 run osmo-hlr_10.42.42.2(pid=16384): Launched 02:56:59.045707 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:59.583438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Launched 02:56:59.887586 run osmo-stp_10.42.42.5(pid=16387): Launched 02:57:00.004242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:00.539250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Launched 02:57:00.655646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:00.916566 run patchelf(pid=16390): Launched 02:57:01.090242 run osmo-stp_10.42.42.5(pid=16387): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] 02:57:01.222754 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-10_02:56:59.831959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:01.356370 run osmo-stp_10.42.42.5(pid=16387): stderr: | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025700002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:01.510364 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-10_02:56:59.831959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:01.687093 run osmo-stp_10.42.42.5(pid=16387): stderr: | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025700001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025700002 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025700002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:01.841553 run patchelf(pid=16390): Terminating (SIGINT) 02:57:02.021372 run patchelf(pid=16390): Terminated: ok {rc=0} 02:57:02.148519 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 02:57:02.158969 tst iperf3.py:8: Test FAILED (7.6 sec) 02:57:02.189759 run osmo-hlr_10.42.42.2(pid=16384): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16384)] 02:57:02.240781 run osmo-hlr_10.42.42.2(pid=16384): stdout: | (launched: 2022-12-10_02:56:58.874186) 02:57:02.294131 run osmo-hlr_10.42.42.2(pid=16384): stderr: | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025659053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025659065 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025659074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025659075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025659075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:02.345673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Terminating (SIGTERM) 02:57:02.386724 run iperf3-srv_10.42.42.10(pid=16380): Terminating (SIGTERM) 02:57:02.427904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminating (SIGTERM) 02:57:02.468888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminating (SIGTERM) 02:57:02.510082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Terminating (SIGTERM) 02:57:02.551333 --- ParallelTerminationStrategy: PID 16379 died... 02:57:02.570662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16379): Terminated: ok {rc=0} 02:57:02.616728 --- ParallelTerminationStrategy: PID 16380 died... 02:57:02.635657 run iperf3-srv_10.42.42.10(pid=16380): Terminated {rc=256} 02:57:02.681587 --- ParallelTerminationStrategy: PID 16383 died... 02:57:02.700419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminated: ok {rc=0} 02:57:02.746288 --- ParallelTerminationStrategy: PID 16386 died... 02:57:02.765125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminated: ok {rc=0} 02:57:02.811070 --- ParallelTerminationStrategy: PID 16389 died... 02:57:02.829987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16389): Terminated: ok {rc=0} 02:57:02.917714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:57:04.069280 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.080429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:04.128724 tst iperf3m4.py: using LAC 25505 02:57:04.250393 tst iperf3m4.py: using RAC 5 02:57:04.371724 tst iperf3m4.py: using CellId 25505 02:57:04.493523 tst iperf3m4.py: using BVCI 25506 02:57:04.614817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.626267 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.637476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.649209 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.660681 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.672466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.684582 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.696130 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:04.707813 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:04.827041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:04.946050 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:05.066740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:05.190441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:05.409513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:05.735486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16391): Launched 02:57:06.019082 run iperf3-srv_10.42.42.10(pid=16392): Launched 02:57:06.142091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:57:06.360379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:06.686499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16393): Launched 02:57:06.969220 run iperf3-srv_10.42.42.10(pid=16394): Launched 02:57:07.091540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:57:07.311196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:07.638015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16395): Launched 02:57:07.920405 run iperf3-srv_10.42.42.10(pid=16396): Launched 02:57:08.042508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:57:08.260796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:08.586752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16397): Launched 02:57:08.869906 run iperf3-srv_10.42.42.10(pid=16398): Launched 02:57:08.991807 tst iperf3m4.py:8: start network... 02:57:09.210365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:09.716812 run create_hlr_db(pid=16399): Launched 02:57:09.848525 bus /gobi_6: Setting Powered False 02:57:10.912614 run create_hlr_db(pid=16399): Terminated: ok {rc=0} 02:57:11.364546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16401): Launched 02:57:11.690229 run osmo-hlr_10.42.42.2(pid=16402): Launched 02:57:11.815196 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:12.379264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16404): Launched 02:57:12.704380 run osmo-stp_10.42.42.5(pid=16405): Launched 02:57:12.828735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:13.390186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16407): Launched 02:57:13.514994 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:13.789384 run patchelf(pid=16408): Launched 02:57:13.971322 run osmo-stp_10.42.42.5(pid=16405): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16405)] 02:57:14.109169 run osmo-stp_10.42.42.5(pid=16405): stdout: | (launched: 2022-12-10_02:57:12.645075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:14.247768 run osmo-stp_10.42.42.5(pid=16405): stderr: | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025712837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:14.386783 run osmo-stp_10.42.42.5(pid=16405): stdout: | (launched: 2022-12-10_02:57:12.645075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:14.520821 run osmo-stp_10.42.42.5(pid=16405): stderr: | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025712836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025712837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025712839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:14.679410 run patchelf(pid=16408): Terminating (SIGINT) 02:57:14.861670 run patchelf(pid=16408): Terminated: ok {rc=0} 02:57:14.992594 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16405): Process ended prematurely: osmo-stp_10.42.42.5(pid=16405) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16405)] [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 02:57:15.002656 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:57:15.031749 run osmo-hlr_10.42.42.2(pid=16402): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16402)] 02:57:15.082270 run osmo-hlr_10.42.42.2(pid=16402): stdout: | (launched: 2022-12-10_02:57:11.630683) 02:57:15.134675 run osmo-hlr_10.42.42.2(pid=16402): stderr: | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025711829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025711841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025711849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025711849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025711849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:15.187326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16391): Terminating (SIGTERM) 02:57:15.229638 run iperf3-srv_10.42.42.10(pid=16392): Terminating (SIGTERM) 02:57:15.271506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16393): Terminating (SIGTERM) 02:57:15.313724 run iperf3-srv_10.42.42.10(pid=16394): Terminating (SIGTERM) 02:57:15.355535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16395): Terminating (SIGTERM) 02:57:15.397613 run iperf3-srv_10.42.42.10(pid=16396): Terminating (SIGTERM) 02:57:15.439471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16397): Terminating (SIGTERM) 02:57:15.481692 run iperf3-srv_10.42.42.10(pid=16398): Terminating (SIGTERM) 02:57:15.523778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16401): Terminating (SIGTERM) 02:57:15.565694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16404): Terminating (SIGTERM) 02:57:15.607467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16407): Terminating (SIGTERM) 02:57:15.649583 --- ParallelTerminationStrategy: PID 16391 died... 02:57:15.669590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16391): Terminated: ok {rc=0} 02:57:15.716330 --- ParallelTerminationStrategy: PID 16392 died... 02:57:15.736006 run iperf3-srv_10.42.42.10(pid=16392): Terminated {rc=256} 02:57:15.782234 --- ParallelTerminationStrategy: PID 16393 died... 02:57:15.801953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16393): Terminated: ok {rc=0} 02:57:15.854117 --- ParallelTerminationStrategy: PID 16394 died... 02:57:15.876554 run iperf3-srv_10.42.42.10(pid=16394): Terminated {rc=256} 02:57:15.944184 --- ParallelTerminationStrategy: PID 16395 died... 02:57:15.964357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16395): Terminated: ok {rc=0} 02:57:16.011408 --- ParallelTerminationStrategy: PID 16396 died... 02:57:16.033601 run iperf3-srv_10.42.42.10(pid=16396): Terminated {rc=256} 02:57:16.082867 --- ParallelTerminationStrategy: PID 16397 died... 02:57:16.103560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16397): Terminated: ok {rc=0} 02:57:16.152929 --- ParallelTerminationStrategy: PID 16398 died... 02:57:16.173710 run iperf3-srv_10.42.42.10(pid=16398): Terminated {rc=256} 02:57:16.220619 --- ParallelTerminationStrategy: PID 16401 died... 02:57:16.241431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16401): Terminated: ok {rc=0} 02:57:16.288447 --- ParallelTerminationStrategy: PID 16404 died... 02:57:16.308802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16404): Terminated: ok {rc=0} 02:57:16.356132 --- ParallelTerminationStrategy: PID 16407 died... 02:57:16.376354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16407): Terminated: ok {rc=0} 02:57:16.465312 bus /gobi_4: Setting Powered False 02:57:17.565932 bus /gobi_4: Setting Powered False 02:57:18.682316 bus /gobi_1: Setting Powered False 02:57:19.781749 bus /gobi_1: Setting Powered False 02:57:20.898220 bus /gobi_0: Setting Powered False 02:57:21.997934 bus /gobi_0: Setting Powered False 02:57:23.117959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 02:57:24.221951 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.233471 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:24.284244 tst ping.py: using LAC 25506 02:57:24.405677 tst ping.py: using RAC 6 02:57:24.525549 tst ping.py: using CellId 25506 02:57:24.649676 tst ping.py: using BVCI 25507 02:57:24.765405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.776819 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.788035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.799067 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.810333 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.821557 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.832713 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:24.843764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:24.959268 tst ping.py:19: start network... 02:57:25.158786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:25.619748 run create_hlr_db(pid=16409): Launched 02:57:25.734131 bus /gobi_6: Setting Powered False 02:57:26.794606 run create_hlr_db(pid=16409): Terminated: ok {rc=0} 02:57:27.230538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Launched 02:57:27.551379 run osmo-hlr_10.42.42.2(pid=16412): Launched 02:57:27.673765 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:28.203192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16414): Launched 02:57:28.501486 run osmo-stp_10.42.42.5(pid=16415): Launched 02:57:28.617287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:29.133690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16417): Launched 02:57:29.248780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:29.502429 run patchelf(pid=16418): Launched 02:57:29.669971 run osmo-stp_10.42.42.5(pid=16415): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16415)] 02:57:29.796464 run osmo-stp_10.42.42.5(pid=16415): stdout: | (launched: 2022-12-10_02:57:28.446593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:29.924468 run osmo-stp_10.42.42.5(pid=16415): stderr: | [0;m[38;5;43m20221210025728616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025728617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025728617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025728617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:30.053179 run osmo-stp_10.42.42.5(pid=16415): stdout: | (launched: 2022-12-10_02:57:28.446593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:30.175482 run osmo-stp_10.42.42.5(pid=16415): stderr: | [0;m[38;5;43m20221210025728616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025728617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025728617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025728617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025728618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:30.320541 run patchelf(pid=16418): Terminating (SIGINT) 02:57:30.487669 run patchelf(pid=16418): Terminated: ok {rc=0} 02:57:30.608289 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16415): Process ended prematurely: osmo-stp_10.42.42.5(pid=16415) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16415)] [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 02:57:30.617680 tst ping.py:22: Test FAILED (6.4 sec) 02:57:30.644618 run osmo-hlr_10.42.42.2(pid=16412): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16412)] 02:57:30.692826 run osmo-hlr_10.42.42.2(pid=16412): stdout: | (launched: 2022-12-10_02:57:27.492661) 02:57:30.742393 run osmo-hlr_10.42.42.2(pid=16412): stderr: | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025727693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025727708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025727718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025727718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025727718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:30.792643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Terminating (SIGTERM) 02:57:30.845284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16414): Terminating (SIGTERM) 02:57:30.899451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16417): Terminating (SIGTERM) 02:57:30.946337 --- ParallelTerminationStrategy: PID 16411 died... 02:57:30.965793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Terminated: ok {rc=0} 02:57:31.011943 --- ParallelTerminationStrategy: PID 16414 died... 02:57:31.031462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16414): Terminated: ok {rc=0} 02:57:31.077710 --- ParallelTerminationStrategy: PID 16417 died... 02:57:31.097361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16417): Terminated: ok {rc=0} 02:57:31.189446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:57:32.287555 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.300033 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:32.355860 tst ping_idle_ping.py: using LAC 25507 02:57:32.482720 tst ping_idle_ping.py: using RAC 7 02:57:32.609471 tst ping_idle_ping.py: using CellId 25507 02:57:32.733523 tst ping_idle_ping.py: using BVCI 25508 02:57:32.849957 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.861593 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.872700 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.884438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.895997 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.907635 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.919385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:32.930931 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:33.050038 tst ping_idle_ping.py:24: start network... 02:57:33.251365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:33.716716 run create_hlr_db(pid=16419): Launched 02:57:33.832347 bus /gobi_6: Setting Powered False 02:57:34.892567 run create_hlr_db(pid=16419): Terminated: ok {rc=0} 02:57:35.310796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Launched 02:57:35.611144 run osmo-hlr_10.42.42.2(pid=16422): Launched 02:57:35.725202 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:36.241530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16426): Launched 02:57:36.542814 run osmo-stp_10.42.42.5(pid=16427): Launched 02:57:36.657483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:37.175942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16429): Launched 02:57:37.291689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:37.546313 run patchelf(pid=16430): Launched 02:57:37.714399 run osmo-stp_10.42.42.5(pid=16427): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16427)] 02:57:37.841377 run osmo-stp_10.42.42.5(pid=16427): stdout: | (launched: 2022-12-10_02:57:36.487673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:37.969733 run osmo-stp_10.42.42.5(pid=16427): stderr: | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025736660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:38.098466 run osmo-stp_10.42.42.5(pid=16427): stdout: | (launched: 2022-12-10_02:57:36.487673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:38.221312 run osmo-stp_10.42.42.5(pid=16427): stderr: | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025736659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025736660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025736660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:38.366750 run patchelf(pid=16430): Terminating (SIGINT) 02:57:38.534958 run patchelf(pid=16430): Terminated: ok {rc=0} 02:57:38.656162 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16427): Process ended prematurely: osmo-stp_10.42.42.5(pid=16427) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16427)] [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 02:57:38.665162 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:57:38.692195 run osmo-hlr_10.42.42.2(pid=16422): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16422)] 02:57:38.739986 run osmo-hlr_10.42.42.2(pid=16422): stdout: | (launched: 2022-12-10_02:57:35.555958) 02:57:38.789495 run osmo-hlr_10.42.42.2(pid=16422): stderr: | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025735735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025735747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025735756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025735756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025735756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:38.839390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Terminating (SIGTERM) 02:57:38.878754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16426): Terminating (SIGTERM) 02:57:38.918543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16429): Terminating (SIGTERM) 02:57:38.959075 --- ParallelTerminationStrategy: PID 16421 died... 02:57:38.977978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16421): Terminated: ok {rc=0} 02:57:39.023154 --- ParallelTerminationStrategy: PID 16426 died... 02:57:39.042020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16426): Terminated: ok {rc=0} 02:57:39.086706 --- ParallelTerminationStrategy: PID 16429 died... 02:57:39.105508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16429): Terminated: ok {rc=0} 02:57:39.190680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:57:40.490741 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:57:40.496903 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:57:40.530663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:57:40.569046 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:57:40.655041 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:57:40.687753 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:57:40.725973 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:57:41.318743 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:57:41.373605 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:41.384878 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:57:41.457434 tst cs_paging_gprs_active.py: using LAC 25508 02:57:41.579467 tst cs_paging_gprs_active.py: using RAC 8 02:57:41.701149 tst cs_paging_gprs_active.py: using CellId 25508 02:57:41.823795 tst cs_paging_gprs_active.py: using BVCI 25509 02:57:41.944925 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:41.956745 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:41.968074 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:41.979935 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:41.991704 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:42.003514 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:42.015332 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:42.026803 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:42.038550 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:57:42.158058 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:57:42.275271 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:57:42.480885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:42.787492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16435): Launched 02:57:43.053740 run iperf3-srv_10.42.42.10(pid=16436): Launched 02:57:43.168919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:57:43.371909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:43.678042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16437): Launched 02:57:43.943046 run iperf3-srv_10.42.42.10(pid=16438): Launched 02:57:44.057811 tst cs_paging_gprs_active.py:38: start network... 02:57:44.260804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:44.730980 run create_hlr_db(pid=16439): Launched 02:57:44.849095 bus /gobi_6: Setting Powered False 02:57:45.920012 run create_hlr_db(pid=16439): Terminated: ok {rc=0} 02:57:46.358682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16441): Launched 02:57:46.685738 run osmo-hlr_10.42.42.2(pid=16442): Launched 02:57:46.870437 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:47.573941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16444): Launched 02:57:47.877170 run osmo-stp_10.42.42.5(pid=16445): Launched 02:57:47.993279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:48.515432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16447): Launched 02:57:48.632115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:48.895402 run patchelf(pid=16448): Launched 02:57:49.064715 run osmo-stp_10.42.42.5(pid=16445): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16445)] 02:57:49.193593 run osmo-stp_10.42.42.5(pid=16445): stdout: | (launched: 2022-12-10_02:57:47.821487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:49.323631 run osmo-stp_10.42.42.5(pid=16445): stderr: | [0;m[38;5;43m20221210025747990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025747991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025747991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025747991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:49.454456 run osmo-stp_10.42.42.5(pid=16445): stdout: | (launched: 2022-12-10_02:57:47.821487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:49.579864 run osmo-stp_10.42.42.5(pid=16445): stderr: | [0;m[38;5;43m20221210025747990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025747991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025747991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025747991 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025747992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:49.727680 run patchelf(pid=16448): Terminating (SIGINT) 02:57:49.898621 run patchelf(pid=16448): Terminated: ok {rc=0} 02:57:50.021795 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16445): Process ended prematurely: osmo-stp_10.42.42.5(pid=16445) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16445)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:57:50.031109 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:57:50.058620 run osmo-hlr_10.42.42.2(pid=16442): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16442)] 02:57:50.106780 run osmo-hlr_10.42.42.2(pid=16442): stdout: | (launched: 2022-12-10_02:57:46.618629) 02:57:50.156160 run osmo-hlr_10.42.42.2(pid=16442): stderr: | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025746967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025746986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025747002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025747002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025747002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:50.205909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16435): Terminating (SIGTERM) 02:57:50.245591 run iperf3-srv_10.42.42.10(pid=16436): Terminating (SIGTERM) 02:57:50.285324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16437): Terminating (SIGTERM) 02:57:50.325720 run iperf3-srv_10.42.42.10(pid=16438): Terminating (SIGTERM) 02:57:50.365219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16441): Terminating (SIGTERM) 02:57:50.404991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16444): Terminating (SIGTERM) 02:57:50.444556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16447): Terminating (SIGTERM) 02:57:50.484555 --- ParallelTerminationStrategy: PID 16435 died... 02:57:50.503679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16435): Terminated: ok {rc=0} 02:57:50.547818 --- ParallelTerminationStrategy: PID 16436 died... 02:57:50.566355 run iperf3-srv_10.42.42.10(pid=16436): Terminated {rc=256} 02:57:50.610348 --- ParallelTerminationStrategy: PID 16437 died... 02:57:50.628815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16437): Terminated: ok {rc=0} 02:57:50.673369 --- ParallelTerminationStrategy: PID 16438 died... 02:57:50.691969 run iperf3-srv_10.42.42.10(pid=16438): Terminated {rc=256} 02:57:50.735911 --- ParallelTerminationStrategy: PID 16441 died... 02:57:50.754490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16441): Terminated: ok {rc=0} 02:57:50.798879 --- ParallelTerminationStrategy: PID 16444 died... 02:57:50.817466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16444): Terminated: ok {rc=0} 02:57:50.861532 --- ParallelTerminationStrategy: PID 16447 died... 02:57:50.880036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16447): Terminated: ok {rc=0} 02:57:50.963845 bus /gobi_0: Setting Powered False 02:57:52.062567 bus /gobi_0: Setting Powered False 02:57:53.178661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:57:54.328000 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.339875 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:57:54.415467 tst iperf3.py: using LAC 25509 02:57:54.534865 tst iperf3.py: using RAC 9 02:57:54.652454 tst iperf3.py: using CellId 25509 02:57:54.770089 tst iperf3.py: using BVCI 25510 02:57:54.880739 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.891905 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.902653 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.913804 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.925083 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.936161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.947256 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.958113 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:54.969380 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:57:55.088530 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:55.307919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:55.634157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16449): Launched 02:57:55.917248 run iperf3-srv_10.42.42.10(pid=16450): Launched 02:57:56.039257 tst iperf3.py:8: start network... 02:57:56.258034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:56.761968 run create_hlr_db(pid=16451): Launched 02:57:56.895585 bus /gobi_6: Setting Powered False 02:57:57.959473 run create_hlr_db(pid=16451): Terminated: ok {rc=0} 02:57:58.391816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16453): Launched 02:57:58.697258 run osmo-hlr_10.42.42.2(pid=16454): Launched 02:57:58.814079 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:59.352377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16456): Launched 02:57:59.657722 run osmo-stp_10.42.42.5(pid=16457): Launched 02:57:59.774461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:00.298173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16459): Launched 02:58:00.414900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:00.671647 run patchelf(pid=16460): Launched 02:58:00.843033 run osmo-stp_10.42.42.5(pid=16457): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16457)] 02:58:00.999621 run osmo-stp_10.42.42.5(pid=16457): stdout: | (launched: 2022-12-10_02:57:59.601756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:01.132377 run osmo-stp_10.42.42.5(pid=16457): stderr: | [0;m[38;5;43m20221210025759771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025759771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025759772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025759772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:01.265247 run osmo-stp_10.42.42.5(pid=16457): stdout: | (launched: 2022-12-10_02:57:59.601756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:01.392298 run osmo-stp_10.42.42.5(pid=16457): stderr: | [0;m[38;5;43m20221210025759771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025759771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025759772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025759772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025759773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:01.543590 run patchelf(pid=16460): Terminating (SIGINT) 02:58:01.718132 run patchelf(pid=16460): Terminated: ok {rc=0} 02:58:01.843792 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16457): Process ended prematurely: osmo-stp_10.42.42.5(pid=16457) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16457)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 02:58:01.853844 tst iperf3.py:8: Test FAILED (7.6 sec) 02:58:01.882818 run osmo-hlr_10.42.42.2(pid=16454): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16454)] 02:58:01.931941 run osmo-hlr_10.42.42.2(pid=16454): stdout: | (launched: 2022-12-10_02:57:58.641222) 02:58:01.982598 run osmo-hlr_10.42.42.2(pid=16454): stderr: | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025758818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025758831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025758839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025758840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025758840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:02.034043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16449): Terminating (SIGTERM) 02:58:02.075595 run iperf3-srv_10.42.42.10(pid=16450): Terminating (SIGTERM) 02:58:02.119500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16453): Terminating (SIGTERM) 02:58:02.160797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16456): Terminating (SIGTERM) 02:58:02.201463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16459): Terminating (SIGTERM) 02:58:02.242910 --- ParallelTerminationStrategy: PID 16449 died... 02:58:02.262057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16449): Terminated: ok {rc=0} 02:58:02.306890 --- ParallelTerminationStrategy: PID 16450 died... 02:58:02.325631 run iperf3-srv_10.42.42.10(pid=16450): Terminated {rc=256} 02:58:02.369724 --- ParallelTerminationStrategy: PID 16453 died... 02:58:02.388369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16453): Terminated: ok {rc=0} 02:58:02.433127 --- ParallelTerminationStrategy: PID 16456 died... 02:58:02.451665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16456): Terminated: ok {rc=0} 02:58:02.496025 --- ParallelTerminationStrategy: PID 16459 died... 02:58:02.514853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16459): Terminated: ok {rc=0} 02:58:02.601261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:58:03.749171 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:03.760623 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:03.830999 tst iperf3m4.py: using LAC 25510 02:58:03.951782 tst iperf3m4.py: using RAC 10 02:58:04.072831 tst iperf3m4.py: using CellId 25510 02:58:04.196759 tst iperf3m4.py: using BVCI 25511 02:58:04.308381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.319348 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.330027 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.341109 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.351916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.362752 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.373670 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.384498 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:04.395659 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:04.516013 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:04.638169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:04.757654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:04.874266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:05.078656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:05.383698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16461): Launched 02:58:05.649586 run iperf3-srv_10.42.42.10(pid=16462): Launched 02:58:05.765319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:58:05.969314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:06.275725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16463): Launched 02:58:06.541212 run iperf3-srv_10.42.42.10(pid=16464): Launched 02:58:06.656372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:58:06.859416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:07.163147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16465): Launched 02:58:07.427610 run iperf3-srv_10.42.42.10(pid=16466): Launched 02:58:07.542699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:58:07.745952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:08.050567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16467): Launched 02:58:08.315373 run iperf3-srv_10.42.42.10(pid=16468): Launched 02:58:08.430006 tst iperf3m4.py:8: start network... 02:58:08.632336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:09.104516 run create_hlr_db(pid=16469): Launched 02:58:09.221988 bus /gobi_6: Setting Powered False 02:58:10.282411 run create_hlr_db(pid=16469): Terminated: ok {rc=0} 02:58:10.706253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Launched 02:58:11.009577 run osmo-hlr_10.42.42.2(pid=16472): Launched 02:58:11.126868 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:11.667077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Launched 02:58:11.970369 run osmo-stp_10.42.42.5(pid=16475): Launched 02:58:12.086421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:12.608276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16477): Launched 02:58:12.724728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:12.980776 run patchelf(pid=16478): Launched 02:58:13.150043 run osmo-stp_10.42.42.5(pid=16475): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] 02:58:13.278888 run osmo-stp_10.42.42.5(pid=16475): stdout: | (launched: 2022-12-10_02:58:11.914839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:13.408683 run osmo-stp_10.42.42.5(pid=16475): stderr: | [0;m[38;5;43m20221210025812084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025812085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025812085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025812085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:13.539077 run osmo-stp_10.42.42.5(pid=16475): stdout: | (launched: 2022-12-10_02:58:11.914839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:13.664284 run osmo-stp_10.42.42.5(pid=16475): stderr: | [0;m[38;5;43m20221210025812084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025812085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025812085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025812085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025812086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:13.812411 run patchelf(pid=16478): Terminating (SIGINT) 02:58:13.983394 run patchelf(pid=16478): Terminated: ok {rc=0} 02:58:14.106210 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16475): Process ended prematurely: osmo-stp_10.42.42.5(pid=16475) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:58:14.115552 tst iperf3m4.py:8: Test FAILED (10.4 sec) 02:58:14.143631 run osmo-hlr_10.42.42.2(pid=16472): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16472)] 02:58:14.191925 run osmo-hlr_10.42.42.2(pid=16472): stdout: | (launched: 2022-12-10_02:58:10.953740) 02:58:14.241396 run osmo-hlr_10.42.42.2(pid=16472): stderr: | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025811132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025811144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025811152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025811152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025811152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:14.291382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16461): Terminating (SIGTERM) 02:58:14.331450 run iperf3-srv_10.42.42.10(pid=16462): Terminating (SIGTERM) 02:58:14.371287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16463): Terminating (SIGTERM) 02:58:14.411388 run iperf3-srv_10.42.42.10(pid=16464): Terminating (SIGTERM) 02:58:14.451234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16465): Terminating (SIGTERM) 02:58:14.491152 run iperf3-srv_10.42.42.10(pid=16466): Terminating (SIGTERM) 02:58:14.530974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16467): Terminating (SIGTERM) 02:58:14.570923 run iperf3-srv_10.42.42.10(pid=16468): Terminating (SIGTERM) 02:58:14.611155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Terminating (SIGTERM) 02:58:14.650974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Terminating (SIGTERM) 02:58:14.690864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16477): Terminating (SIGTERM) 02:58:14.730950 --- ParallelTerminationStrategy: PID 16461 died... 02:58:14.750114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16461): Terminated: ok {rc=0} 02:58:14.794760 --- ParallelTerminationStrategy: PID 16462 died... 02:58:14.813668 run iperf3-srv_10.42.42.10(pid=16462): Terminated {rc=256} 02:58:14.858186 --- ParallelTerminationStrategy: PID 16463 died... 02:58:14.877025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16463): Terminated: ok {rc=0} 02:58:14.921515 --- ParallelTerminationStrategy: PID 16464 died... 02:58:14.940337 run iperf3-srv_10.42.42.10(pid=16464): Terminated {rc=256} 02:58:14.985167 --- ParallelTerminationStrategy: PID 16465 died... 02:58:15.003836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16465): Terminated: ok {rc=0} 02:58:15.048411 --- ParallelTerminationStrategy: PID 16466 died... 02:58:15.067081 run iperf3-srv_10.42.42.10(pid=16466): Terminated {rc=256} 02:58:15.111274 --- ParallelTerminationStrategy: PID 16467 died... 02:58:15.129996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16467): Terminated: ok {rc=0} 02:58:15.174426 --- ParallelTerminationStrategy: PID 16468 died... 02:58:15.193211 run iperf3-srv_10.42.42.10(pid=16468): Terminated {rc=256} 02:58:15.237367 --- ParallelTerminationStrategy: PID 16471 died... 02:58:15.256062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Terminated: ok {rc=0} 02:58:15.300431 --- ParallelTerminationStrategy: PID 16474 died... 02:58:15.319231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Terminated: ok {rc=0} 02:58:15.363743 --- ParallelTerminationStrategy: PID 16477 died... 02:58:15.382592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16477): Terminated: ok {rc=0} 02:58:15.468719 bus /gobi_4: Setting Powered False 02:58:16.568860 bus /gobi_4: Setting Powered False 02:58:17.690471 bus /gobi_1: Setting Powered False 02:58:18.790712 bus /gobi_1: Setting Powered False 02:58:19.907574 bus /gobi_0: Setting Powered False 02:58:21.006464 bus /gobi_0: Setting Powered False 02:58:22.125683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:58:23.229019 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.240460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:23.310446 tst ping.py: using LAC 25511 02:58:23.429784 tst ping.py: using RAC 11 02:58:23.546883 tst ping.py: using CellId 25511 02:58:23.663551 tst ping.py: using BVCI 25512 02:58:23.774742 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.785755 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.796619 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.807528 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.818443 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.829559 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.840469 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:23.851283 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:23.970446 tst ping.py:19: start network... 02:58:24.184306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:24.676855 run create_hlr_db(pid=16479): Launched 02:58:24.807386 bus /gobi_6: Setting Powered False 02:58:25.870007 run create_hlr_db(pid=16479): Terminated: ok {rc=0} 02:58:26.313161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16481): Launched 02:58:26.631761 run osmo-hlr_10.42.42.2(pid=16482): Launched 02:58:26.752899 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:27.303168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16484): Launched 02:58:27.623414 run osmo-stp_10.42.42.5(pid=16485): Launched 02:58:27.745345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:28.296492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16487): Launched 02:58:28.418809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:28.688107 run patchelf(pid=16488): Launched 02:58:28.866927 run osmo-stp_10.42.42.5(pid=16485): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16485)] 02:58:29.001830 run osmo-stp_10.42.42.5(pid=16485): stdout: | (launched: 2022-12-10_02:58:27.564877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:29.138555 run osmo-stp_10.42.42.5(pid=16485): stderr: | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025827758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:29.275255 run osmo-stp_10.42.42.5(pid=16485): stdout: | (launched: 2022-12-10_02:58:27.564877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:29.406358 run osmo-stp_10.42.42.5(pid=16485): stderr: | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025827757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025827758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025827758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:29.561552 run patchelf(pid=16488): Terminating (SIGINT) 02:58:29.740310 run patchelf(pid=16488): Terminated: ok {rc=0} 02:58:29.869667 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16485): Process ended prematurely: osmo-stp_10.42.42.5(pid=16485) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16485)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 02:58:29.879364 tst ping.py:22: Test FAILED (6.6 sec) 02:58:29.907490 run osmo-hlr_10.42.42.2(pid=16482): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16482)] 02:58:29.957553 run osmo-hlr_10.42.42.2(pid=16482): stdout: | (launched: 2022-12-10_02:58:26.573264) 02:58:30.009479 run osmo-hlr_10.42.42.2(pid=16482): stderr: | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025826771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025826784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025826793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025826793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025826793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:30.062048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16481): Terminating (SIGTERM) 02:58:30.104096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16484): Terminating (SIGTERM) 02:58:30.146496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16487): Terminating (SIGTERM) 02:58:30.188709 --- ParallelTerminationStrategy: PID 16481 died... 02:58:30.209032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16481): Terminated: ok {rc=0} 02:58:30.255704 --- ParallelTerminationStrategy: PID 16484 died... 02:58:30.275465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16484): Terminated: ok {rc=0} 02:58:30.321963 --- ParallelTerminationStrategy: PID 16487 died... 02:58:30.341742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16487): Terminated: ok {rc=0} 02:58:30.430457 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:58:31.515559 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:31.528221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:31.603148 tst ping_idle_ping.py: using LAC 25512 02:58:31.731472 tst ping_idle_ping.py: using RAC 12 02:58:31.877466 tst ping_idle_ping.py: using CellId 25512 02:58:32.051026 tst ping_idle_ping.py: using BVCI 25513 02:58:32.163933 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.175841 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.187640 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.200533 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.213226 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.226469 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.239475 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:32.251877 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:32.373094 tst ping_idle_ping.py:24: start network... 02:58:32.588264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:33.086916 run create_hlr_db(pid=16489): Launched 02:58:33.218619 bus /gobi_6: Setting Powered False 02:58:34.282846 run create_hlr_db(pid=16489): Terminated: ok {rc=0} 02:58:34.713915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16491): Launched 02:58:35.014974 run osmo-hlr_10.42.42.2(pid=16492): Launched 02:58:35.129153 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:35.647571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16494): Launched 02:58:35.947575 run osmo-stp_10.42.42.5(pid=16495): Launched 02:58:36.062415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:36.578560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16497): Launched 02:58:36.694404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:36.947534 run patchelf(pid=16498): Launched 02:58:37.116153 run osmo-stp_10.42.42.5(pid=16495): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16495)] 02:58:37.243963 run osmo-stp_10.42.42.5(pid=16495): stdout: | (launched: 2022-12-10_02:58:35.892474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:37.373359 run osmo-stp_10.42.42.5(pid=16495): stderr: | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025836063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:37.503011 run osmo-stp_10.42.42.5(pid=16495): stdout: | (launched: 2022-12-10_02:58:35.892474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:37.626141 run osmo-stp_10.42.42.5(pid=16495): stderr: | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025836063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025836063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025836064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:37.771918 run patchelf(pid=16498): Terminating (SIGINT) 02:58:37.941373 run patchelf(pid=16498): Terminated: ok {rc=0} 02:58:38.063076 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16495): Process ended prematurely: osmo-stp_10.42.42.5(pid=16495) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16495)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:58:38.071899 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:58:38.099214 run osmo-hlr_10.42.42.2(pid=16492): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16492)] 02:58:38.147452 run osmo-hlr_10.42.42.2(pid=16492): stdout: | (launched: 2022-12-10_02:58:34.960069) 02:58:38.197531 run osmo-hlr_10.42.42.2(pid=16492): stderr: | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025835136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025835148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025835157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025835157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025835157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:38.247939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16491): Terminating (SIGTERM) 02:58:38.288421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16494): Terminating (SIGTERM) 02:58:38.328883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16497): Terminating (SIGTERM) 02:58:38.369873 --- ParallelTerminationStrategy: PID 16491 died... 02:58:38.389404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16491): Terminated: ok {rc=0} 02:58:38.434611 --- ParallelTerminationStrategy: PID 16494 died... 02:58:38.453722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16494): Terminated: ok {rc=0} 02:58:38.498646 --- ParallelTerminationStrategy: PID 16497 died... 02:58:38.517985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16497): Terminated: ok {rc=0} 02:58:38.601457 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:58:39.901013 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:58:39.907017 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:58:39.940382 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:58:39.978821 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:58:40.064901 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:58:40.097557 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:58:40.135708 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:58:40.733461 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:58:40.783060 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:40.794120 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:58:40.862436 tst cs_paging_gprs_active.py: using LAC 25513 02:58:40.982347 tst cs_paging_gprs_active.py: using RAC 13 02:58:41.102349 tst cs_paging_gprs_active.py: using CellId 25513 02:58:41.222673 tst cs_paging_gprs_active.py: using BVCI 25514 02:58:41.344869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.356371 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.367656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.379457 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.391302 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.403252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.415156 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.427042 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:41.438917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:58:41.558653 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:58:41.680241 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:58:41.885086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:42.190516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16502): Launched 02:58:42.455235 run iperf3-srv_10.42.42.10(pid=16503): Launched 02:58:42.570787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:58:42.774346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:43.079188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16504): Launched 02:58:43.343720 run iperf3-srv_10.42.42.10(pid=16505): Launched 02:58:43.458638 tst cs_paging_gprs_active.py:38: start network... 02:58:43.661977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:44.134349 run create_hlr_db(pid=16506): Launched 02:58:44.253113 bus /gobi_6: Setting Powered False 02:58:45.314432 run create_hlr_db(pid=16506): Terminated: ok {rc=0} 02:58:45.737924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16508): Launched 02:58:46.057791 run osmo-hlr_10.42.42.2(pid=16509): Launched 02:58:46.292812 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:47.026932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16511): Launched 02:58:47.368328 run osmo-stp_10.42.42.5(pid=16512): Launched 02:58:47.496579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:48.064128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16514): Launched 02:58:48.189379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:48.464870 run patchelf(pid=16515): Launched 02:58:48.648334 run osmo-stp_10.42.42.5(pid=16512): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16512)] 02:58:48.786008 run osmo-stp_10.42.42.5(pid=16512): stdout: | (launched: 2022-12-10_02:58:47.308529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:48.925221 run osmo-stp_10.42.42.5(pid=16512): stderr: | [0;m[38;5;43m20221210025847500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025847501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025847501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025847501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:49.064153 run osmo-stp_10.42.42.5(pid=16512): stdout: | (launched: 2022-12-10_02:58:47.308529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:49.198279 run osmo-stp_10.42.42.5(pid=16512): stderr: | [0;m[38;5;43m20221210025847500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025847501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025847501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025847501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025847502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:49.356271 run patchelf(pid=16515): Terminating (SIGINT) 02:58:49.538821 run patchelf(pid=16515): Terminated: ok {rc=0} 02:58:49.670547 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16512): Process ended prematurely: osmo-stp_10.42.42.5(pid=16512) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16512)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:58:49.680409 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:58:49.708811 run osmo-hlr_10.42.42.2(pid=16509): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16509)] 02:58:49.758701 run osmo-hlr_10.42.42.2(pid=16509): stdout: | (launched: 2022-12-10_02:58:45.995033) 02:58:49.810364 run osmo-hlr_10.42.42.2(pid=16509): stderr: | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025846344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025846359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025846367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025846367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025846368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:49.862656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16502): Terminating (SIGTERM) 02:58:49.904094 run iperf3-srv_10.42.42.10(pid=16503): Terminating (SIGTERM) 02:58:49.945816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16504): Terminating (SIGTERM) 02:58:49.987446 run iperf3-srv_10.42.42.10(pid=16505): Terminating (SIGTERM) 02:58:50.028546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16508): Terminating (SIGTERM) 02:58:50.069965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16511): Terminating (SIGTERM) 02:58:50.111243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16514): Terminating (SIGTERM) 02:58:50.152833 --- ParallelTerminationStrategy: PID 16502 died... 02:58:50.172746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16502): Terminated: ok {rc=0} 02:58:50.218320 --- ParallelTerminationStrategy: PID 16503 died... 02:58:50.237689 run iperf3-srv_10.42.42.10(pid=16503): Terminated {rc=256} 02:58:50.283271 --- ParallelTerminationStrategy: PID 16504 died... 02:58:50.302781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16504): Terminated: ok {rc=0} 02:58:50.348697 --- ParallelTerminationStrategy: PID 16505 died... 02:58:50.368070 run iperf3-srv_10.42.42.10(pid=16505): Terminated {rc=256} 02:58:50.413821 --- ParallelTerminationStrategy: PID 16508 died... 02:58:50.433177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16508): Terminated: ok {rc=0} 02:58:50.478517 --- ParallelTerminationStrategy: PID 16511 died... 02:58:50.497876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16511): Terminated: ok {rc=0} 02:58:50.543635 --- ParallelTerminationStrategy: PID 16514 died... 02:58:50.563087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16514): Terminated: ok {rc=0} 02:58:50.650501 bus /gobi_0: Setting Powered False 02:58:51.749243 bus /gobi_0: Setting Powered False 02:58:52.865379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:58:54.011832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.023543 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:58:54.096899 tst iperf3.py: using LAC 25514 02:58:54.217076 tst iperf3.py: using RAC 14 02:58:54.335499 tst iperf3.py: using CellId 25514 02:58:54.455506 tst iperf3.py: using BVCI 25515 02:58:54.566754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.577876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.588796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.600050 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.611196 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.622305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.633788 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.644934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:54.656358 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:58:54.771871 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:54.975088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:55.279175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16516): Launched 02:58:55.544792 run iperf3-srv_10.42.42.10(pid=16517): Launched 02:58:55.659374 tst iperf3.py:8: start network... 02:58:55.861472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:56.331832 run create_hlr_db(pid=16518): Launched 02:58:56.448508 bus /gobi_6: Setting Powered False 02:58:57.509546 run create_hlr_db(pid=16518): Terminated: ok {rc=0} 02:58:57.953663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16520): Launched 02:58:58.281598 run osmo-hlr_10.42.42.2(pid=16521): Launched 02:58:58.407168 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:58.973597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16523): Launched 02:58:59.300448 run osmo-stp_10.42.42.5(pid=16524): Launched 02:58:59.425608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:59.988164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16526): Launched 02:59:00.114395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:00.389727 run patchelf(pid=16527): Launched 02:59:00.572402 run osmo-stp_10.42.42.5(pid=16524): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16524)] 02:59:00.710372 run osmo-stp_10.42.42.5(pid=16524): stdout: | (launched: 2022-12-10_02:58:59.240381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:00.850698 run osmo-stp_10.42.42.5(pid=16524): stderr: | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025859433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:01.009150 run osmo-stp_10.42.42.5(pid=16524): stdout: | (launched: 2022-12-10_02:58:59.240381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:01.145346 run osmo-stp_10.42.42.5(pid=16524): stderr: | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025859432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025859433 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025859435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:01.307147 run patchelf(pid=16527): Terminating (SIGINT) 02:59:01.493691 run patchelf(pid=16527): Terminated: ok {rc=0} 02:59:01.628055 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16524): Process ended prematurely: osmo-stp_10.42.42.5(pid=16524) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16524)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 02:59:01.638670 tst iperf3.py:8: Test FAILED (7.7 sec) 02:59:01.668289 run osmo-hlr_10.42.42.2(pid=16521): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16521)] 02:59:01.719637 run osmo-hlr_10.42.42.2(pid=16521): stdout: | (launched: 2022-12-10_02:58:58.221972) 02:59:01.772829 run osmo-hlr_10.42.42.2(pid=16521): stderr: | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025858421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025858434 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025858443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025858443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025858443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:01.826454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16516): Terminating (SIGTERM) 02:59:01.870342 run iperf3-srv_10.42.42.10(pid=16517): Terminating (SIGTERM) 02:59:01.916109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16520): Terminating (SIGTERM) 02:59:01.959157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16523): Terminating (SIGTERM) 02:59:02.001708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16526): Terminating (SIGTERM) 02:59:02.045690 --- ParallelTerminationStrategy: PID 16516 died... 02:59:02.066205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16516): Terminated: ok {rc=0} 02:59:02.114827 --- ParallelTerminationStrategy: PID 16517 died... 02:59:02.134949 run iperf3-srv_10.42.42.10(pid=16517): Terminated {rc=256} 02:59:02.182015 --- ParallelTerminationStrategy: PID 16520 died... 02:59:02.202250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16520): Terminated: ok {rc=0} 02:59:02.248501 --- ParallelTerminationStrategy: PID 16523 died... 02:59:02.268203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16523): Terminated: ok {rc=0} 02:59:02.314051 --- ParallelTerminationStrategy: PID 16526 died... 02:59:02.333858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16526): Terminated: ok {rc=0} 02:59:02.422170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:59:03.574350 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:03.586760 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:03.660399 tst iperf3m4.py: using LAC 25515 02:59:03.789615 tst iperf3m4.py: using RAC 15 02:59:03.919185 tst iperf3m4.py: using CellId 25515 02:59:04.047774 tst iperf3m4.py: using BVCI 25516 02:59:04.166665 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.178100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.189277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.200369 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.211433 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.222623 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.233987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.245008 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:04.256287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:04.376027 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:04.497929 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:04.620720 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:04.740537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:59:04.961118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:05.289138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16528): Launched 02:59:05.573574 run iperf3-srv_10.42.42.10(pid=16529): Launched 02:59:05.697209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:59:05.916827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:06.245545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16530): Launched 02:59:06.530158 run iperf3-srv_10.42.42.10(pid=16531): Launched 02:59:06.653802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:59:06.872523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:07.198759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16532): Launched 02:59:07.483169 run iperf3-srv_10.42.42.10(pid=16533): Launched 02:59:07.606549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:59:07.826177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:08.153796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16534): Launched 02:59:08.439235 run iperf3-srv_10.42.42.10(pid=16535): Launched 02:59:08.562702 tst iperf3m4.py:8: start network... 02:59:08.782418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:09.288706 run create_hlr_db(pid=16536): Launched 02:59:09.421543 bus /gobi_6: Setting Powered False 02:59:10.485739 run create_hlr_db(pid=16536): Terminated: ok {rc=0} 02:59:10.939321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16538): Launched 02:59:11.265725 run osmo-hlr_10.42.42.2(pid=16539): Launched 02:59:11.391391 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:11.958231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16541): Launched 02:59:12.284784 run osmo-stp_10.42.42.5(pid=16542): Launched 02:59:12.409787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:12.970579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16544): Launched 02:59:13.095344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:13.369763 run patchelf(pid=16545): Launched 02:59:13.551822 run osmo-stp_10.42.42.5(pid=16542): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16542)] 02:59:13.690099 run osmo-stp_10.42.42.5(pid=16542): stdout: | (launched: 2022-12-10_02:59:12.225295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:13.829575 run osmo-stp_10.42.42.5(pid=16542): stderr: | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025912422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:13.968785 run osmo-stp_10.42.42.5(pid=16542): stdout: | (launched: 2022-12-10_02:59:12.225295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:14.102875 run osmo-stp_10.42.42.5(pid=16542): stderr: | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025912421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025912422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025912422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:14.261633 run patchelf(pid=16545): Terminating (SIGINT) 02:59:14.444449 run patchelf(pid=16545): Terminated: ok {rc=0} 02:59:14.576249 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16542): Process ended prematurely: osmo-stp_10.42.42.5(pid=16542) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16542)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:59:14.586470 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:59:14.615310 run osmo-hlr_10.42.42.2(pid=16539): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16539)] 02:59:14.665328 run osmo-hlr_10.42.42.2(pid=16539): stdout: | (launched: 2022-12-10_02:59:11.205879) 02:59:14.717124 run osmo-hlr_10.42.42.2(pid=16539): stderr: | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025911404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025911417 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025911426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025911426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025911426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:14.769349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16528): Terminating (SIGTERM) 02:59:14.811065 run iperf3-srv_10.42.42.10(pid=16529): Terminating (SIGTERM) 02:59:14.853005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16530): Terminating (SIGTERM) 02:59:14.895031 run iperf3-srv_10.42.42.10(pid=16531): Terminating (SIGTERM) 02:59:14.936799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16532): Terminating (SIGTERM) 02:59:14.978605 run iperf3-srv_10.42.42.10(pid=16533): Terminating (SIGTERM) 02:59:15.020399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16534): Terminating (SIGTERM) 02:59:15.062320 run iperf3-srv_10.42.42.10(pid=16535): Terminating (SIGTERM) 02:59:15.104062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16538): Terminating (SIGTERM) 02:59:15.146072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16541): Terminating (SIGTERM) 02:59:15.187865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16544): Terminating (SIGTERM) 02:59:15.230098 --- ParallelTerminationStrategy: PID 16528 died... 02:59:15.250320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16528): Terminated: ok {rc=0} 02:59:15.296912 --- ParallelTerminationStrategy: PID 16529 died... 02:59:15.316665 run iperf3-srv_10.42.42.10(pid=16529): Terminated {rc=256} 02:59:15.362682 --- ParallelTerminationStrategy: PID 16530 died... 02:59:15.382433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16530): Terminated: ok {rc=0} 02:59:15.428481 --- ParallelTerminationStrategy: PID 16531 died... 02:59:15.448034 run iperf3-srv_10.42.42.10(pid=16531): Terminated {rc=256} 02:59:15.493759 --- ParallelTerminationStrategy: PID 16532 died... 02:59:15.513405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16532): Terminated: ok {rc=0} 02:59:15.559736 --- ParallelTerminationStrategy: PID 16533 died... 02:59:15.579325 run iperf3-srv_10.42.42.10(pid=16533): Terminated {rc=256} 02:59:15.624852 --- ParallelTerminationStrategy: PID 16534 died... 02:59:15.644799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16534): Terminated: ok {rc=0} 02:59:15.690693 --- ParallelTerminationStrategy: PID 16535 died... 02:59:15.710304 run iperf3-srv_10.42.42.10(pid=16535): Terminated {rc=256} 02:59:15.756036 --- ParallelTerminationStrategy: PID 16538 died... 02:59:15.775769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16538): Terminated: ok {rc=0} 02:59:15.821626 --- ParallelTerminationStrategy: PID 16541 died... 02:59:15.842174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16541): Terminated: ok {rc=0} 02:59:15.888461 --- ParallelTerminationStrategy: PID 16544 died... 02:59:15.908357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16544): Terminated: ok {rc=0} 02:59:15.997174 bus /gobi_4: Setting Powered False 02:59:17.103966 bus /gobi_4: Setting Powered False 02:59:18.223501 bus /gobi_1: Setting Powered False 02:59:19.320850 bus /gobi_1: Setting Powered False 02:59:20.436498 bus /gobi_0: Setting Powered False 02:59:21.534498 bus /gobi_0: Setting Powered False 02:59:22.653299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:59:23.756236 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:23.768172 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:23.841212 tst ping.py: using LAC 25516 02:59:23.967225 tst ping.py: using RAC 16 02:59:24.091763 tst ping.py: using CellId 25516 02:59:24.216641 tst ping.py: using BVCI 25517 02:59:24.332657 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.344140 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.355306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.366447 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.377506 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.388535 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.400007 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:24.411161 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:24.526647 tst ping.py:19: start network... 02:59:24.728886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:25.191855 run create_hlr_db(pid=16547): Launched 02:59:25.308053 bus /gobi_6: Setting Powered False 02:59:26.367370 run create_hlr_db(pid=16547): Terminated: ok {rc=0} 02:59:26.806395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16549): Launched 02:59:27.127719 run osmo-hlr_10.42.42.2(pid=16550): Launched 02:59:27.250681 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:27.804498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16552): Launched 02:59:28.123701 run osmo-stp_10.42.42.5(pid=16553): Launched 02:59:28.245218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:28.797814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16555): Launched 02:59:28.921473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:29.192693 run patchelf(pid=16556): Launched 02:59:29.371549 run osmo-stp_10.42.42.5(pid=16553): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16553)] 02:59:29.507055 run osmo-stp_10.42.42.5(pid=16553): stdout: | (launched: 2022-12-10_02:59:28.065143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:29.644731 run osmo-stp_10.42.42.5(pid=16553): stderr: | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025928258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:29.781775 run osmo-stp_10.42.42.5(pid=16553): stdout: | (launched: 2022-12-10_02:59:28.065143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:29.913206 run osmo-stp_10.42.42.5(pid=16553): stderr: | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025928257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025928258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025928258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:30.068388 run patchelf(pid=16556): Terminating (SIGINT) 02:59:30.248337 run patchelf(pid=16556): Terminated: ok {rc=0} 02:59:30.378335 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16553): Process ended prematurely: osmo-stp_10.42.42.5(pid=16553) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16553)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 02:59:30.387533 tst ping.py:22: Test FAILED (6.6 sec) 02:59:30.415669 run osmo-hlr_10.42.42.2(pid=16550): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16550)] 02:59:30.465411 run osmo-hlr_10.42.42.2(pid=16550): stdout: | (launched: 2022-12-10_02:59:27.069115) 02:59:30.517794 run osmo-hlr_10.42.42.2(pid=16550): stderr: | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025927266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025927279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025927287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:30.570151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16549): Terminating (SIGTERM) 02:59:30.611702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16552): Terminating (SIGTERM) 02:59:30.653239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16555): Terminating (SIGTERM) 02:59:30.695259 --- ParallelTerminationStrategy: PID 16549 died... 02:59:30.715300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16549): Terminated: ok {rc=0} 02:59:30.761563 --- ParallelTerminationStrategy: PID 16552 died... 02:59:30.780894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16552): Terminated: ok {rc=0} 02:59:30.827159 --- ParallelTerminationStrategy: PID 16555 died... 02:59:30.847660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16555): Terminated: ok {rc=0} 02:59:30.951297 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:59:32.042058 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.058212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:32.146131 tst ping_idle_ping.py: using LAC 25517 02:59:32.266656 tst ping_idle_ping.py: using RAC 17 02:59:32.386691 tst ping_idle_ping.py: using CellId 25517 02:59:32.507000 tst ping_idle_ping.py: using BVCI 25518 02:59:32.618262 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.629311 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.640119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.651078 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.662050 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.673131 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.684289 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:32.695273 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:32.812456 tst ping_idle_ping.py:24: start network... 02:59:33.013163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:33.481047 run create_hlr_db(pid=16557): Launched 02:59:33.596511 bus /gobi_6: Setting Powered False 02:59:34.657564 run create_hlr_db(pid=16557): Terminated: ok {rc=0} 02:59:35.097209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16559): Launched 02:59:35.418288 run osmo-hlr_10.42.42.2(pid=16560): Launched 02:59:35.541585 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:36.096711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16562): Launched 02:59:36.417305 run osmo-stp_10.42.42.5(pid=16563): Launched 02:59:36.540353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:37.095326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16565): Launched 02:59:37.218199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:37.489076 run patchelf(pid=16566): Launched 02:59:37.668801 run osmo-stp_10.42.42.5(pid=16563): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16563)] 02:59:37.803938 run osmo-stp_10.42.42.5(pid=16563): stdout: | (launched: 2022-12-10_02:59:36.358561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:37.940699 run osmo-stp_10.42.42.5(pid=16563): stderr: | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025936550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:38.077669 run osmo-stp_10.42.42.5(pid=16563): stdout: | (launched: 2022-12-10_02:59:36.358561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:38.208620 run osmo-stp_10.42.42.5(pid=16563): stderr: | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025936550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025936550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025936551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:38.363975 run patchelf(pid=16566): Terminating (SIGINT) 02:59:38.543135 run patchelf(pid=16566): Terminated: ok {rc=0} 02:59:38.672447 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16563): Process ended prematurely: osmo-stp_10.42.42.5(pid=16563) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16563)] [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:59:38.681895 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:59:38.710124 run osmo-hlr_10.42.42.2(pid=16560): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16560)] 02:59:38.760484 run osmo-hlr_10.42.42.2(pid=16560): stdout: | (launched: 2022-12-10_02:59:35.359701) 02:59:38.812773 run osmo-hlr_10.42.42.2(pid=16560): stderr: | [0;m[1;31m20221210025935557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025935557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025935557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025935557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025935557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025935558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025935570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025935578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025935578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025935578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:38.865508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16559): Terminating (SIGTERM) 02:59:38.907569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16562): Terminating (SIGTERM) 02:59:38.949843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16565): Terminating (SIGTERM) 02:59:38.992286 --- ParallelTerminationStrategy: PID 16559 died... 02:59:39.012395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16559): Terminated: ok {rc=0} 02:59:39.058977 --- ParallelTerminationStrategy: PID 16562 died... 02:59:39.078703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16562): Terminated: ok {rc=0} 02:59:39.124767 --- ParallelTerminationStrategy: PID 16565 died... 02:59:39.144565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16565): Terminated: ok {rc=0} 02:59:39.232698 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:59:40.539588 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:59:40.546533 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:59:40.581944 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:59:40.616886 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:59:40.670057 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:59:40.704582 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:59:40.740651 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:59:41.295108 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:59:41.301177 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.312854 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:59:41.382132 tst switch_tch_pdch.py: using LAC 25518 02:59:41.501090 tst switch_tch_pdch.py: using RAC 18 02:59:41.617954 tst switch_tch_pdch.py: using CellId 25518 02:59:41.746496 tst switch_tch_pdch.py: using BVCI 25519 02:59:41.862971 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.874727 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.886255 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.897805 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.909279 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.920577 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.932188 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:41.943496 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:59:42.063015 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:59:42.189532 tst switch_tch_pdch.py:51: start network... 02:59:42.406445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:42.901639 run create_hlr_db(pid=16570): Launched 02:59:43.031656 bus /gobi_6: Setting Powered False 02:59:44.094716 run create_hlr_db(pid=16570): Terminated: ok {rc=0} 02:59:44.523506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Launched 02:59:44.823462 run osmo-hlr_10.42.42.2(pid=16573): Launched 02:59:44.937441 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:45.454586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Launched 02:59:45.753021 run osmo-stp_10.42.42.5(pid=16576): Launched 02:59:45.902268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:46.563697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16578): Launched 02:59:46.707135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:46.969577 run patchelf(pid=16579): Launched 02:59:47.157797 run osmo-stp_10.42.42.5(pid=16576): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] 02:59:47.296698 run osmo-stp_10.42.42.5(pid=16576): stdout: | (launched: 2022-12-10_02:59:45.698125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:47.433887 run osmo-stp_10.42.42.5(pid=16576): stderr: | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025945908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:47.571533 run osmo-stp_10.42.42.5(pid=16576): stdout: | (launched: 2022-12-10_02:59:45.698125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:47.702849 run osmo-stp_10.42.42.5(pid=16576): stderr: | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025945907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025945908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025945918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:47.857785 run patchelf(pid=16579): Terminating (SIGINT) 02:59:48.036794 run patchelf(pid=16579): Terminated: ok {rc=0} 02:59:48.166154 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16576): Process ended prematurely: osmo-stp_10.42.42.5(pid=16576) [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:59:48.175783 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 02:59:48.204106 run osmo-hlr_10.42.42.2(pid=16573): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16573)] 02:59:48.254160 run osmo-hlr_10.42.42.2(pid=16573): stdout: | (launched: 2022-12-10_02:59:44.767771) 02:59:48.305964 run osmo-hlr_10.42.42.2(pid=16573): stderr: | [0;m[1;31m20221210025944941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025944942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025944942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025944942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025944942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025944942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025944954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025944963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025944963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025944963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:48.358399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Terminating (SIGTERM) 02:59:48.400667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Terminating (SIGTERM) 02:59:48.443051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16578): Terminating (SIGTERM) 02:59:48.485193 --- ParallelTerminationStrategy: PID 16572 died... 02:59:48.505377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Terminated: ok {rc=0} 02:59:48.551843 --- ParallelTerminationStrategy: PID 16575 died... 02:59:48.571643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Terminated: ok {rc=0} 02:59:48.617878 --- ParallelTerminationStrategy: PID 16578 died... 02:59:48.637683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16578): Terminated: ok {rc=0} 02:59:48.725948 bus /gobi_0: Setting Powered False 02:59:49.825350 bus /gobi_0: Setting Powered False 02:59:50.941770 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:59:52.192618 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:59:52.198219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:59:52.231343 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:59:52.265626 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:59:52.318255 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:59:52.351062 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:59:52.385335 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:59:52.945725 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:59:52.951945 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:52.963992 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:59:53.037209 tst switch_tch_pdch.py: using LAC 25519 02:59:53.164894 tst switch_tch_pdch.py: using RAC 19 02:59:53.290761 tst switch_tch_pdch.py: using CellId 25519 02:59:53.418169 tst switch_tch_pdch.py: using BVCI 25520 02:59:53.528541 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.539538 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.550367 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.561749 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.572584 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.583685 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.594791 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:53.605747 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:59:53.720831 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:59:53.836695 tst switch_tch_pdch.py:51: start network... 02:59:54.035578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:54.471663 run create_hlr_db(pid=16585): Launched 02:59:54.586556 bus /gobi_6: Setting Powered False 02:59:55.645763 run create_hlr_db(pid=16585): Terminated: ok {rc=0} 02:59:56.054814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16587): Launched 02:59:56.374058 run osmo-hlr_10.42.42.2(pid=16588): Launched 02:59:56.496132 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:57.017757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Launched 02:59:57.337669 run osmo-stp_10.42.42.5(pid=16591): Launched 02:59:57.459753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:57.984845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16593): Launched 02:59:58.107531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:58.377773 run patchelf(pid=16594): Launched 02:59:58.557026 run osmo-stp_10.42.42.5(pid=16591): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16591)] 02:59:58.692885 run osmo-stp_10.42.42.5(pid=16591): stdout: | (launched: 2022-12-10_02:59:57.279274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:58.829282 run osmo-stp_10.42.42.5(pid=16591): stderr: | [0;m[38;5;43m20221210025957471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025957471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025957472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025957472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025957474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025957474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025957475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:58.965918 run osmo-stp_10.42.42.5(pid=16591): stdout: | (launched: 2022-12-10_02:59:57.279274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:59.096834 run osmo-stp_10.42.42.5(pid=16591): stderr: | [0;m[38;5;43m20221210025957471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210025957471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210025957472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210025957472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210025957474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210025957474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210025957475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:59.251373 run patchelf(pid=16594): Terminating (SIGINT) 02:59:59.431697 run patchelf(pid=16594): Terminated: ok {rc=0} 02:59:59.560558 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16591): Process ended prematurely: osmo-stp_10.42.42.5(pid=16591) [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16591)] [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:59:59.569918 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 02:59:59.598111 run osmo-hlr_10.42.42.2(pid=16588): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16588)] 02:59:59.647933 run osmo-hlr_10.42.42.2(pid=16588): stdout: | (launched: 2022-12-10_02:59:56.315610) 02:59:59.699372 run osmo-hlr_10.42.42.2(pid=16588): stderr: | [0;m[1;31m20221210025956514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210025956514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210025956514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210025956515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210025956515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210025956515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210025956536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210025956546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210025956547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210025956547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:59.751180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16587): Terminating (SIGTERM) 02:59:59.792462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Terminating (SIGTERM) 02:59:59.833887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16593): Terminating (SIGTERM) 02:59:59.875254 --- ParallelTerminationStrategy: PID 16587 died... 02:59:59.894765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16587): Terminated: ok {rc=0} 02:59:59.940554 --- ParallelTerminationStrategy: PID 16590 died... 02:59:59.960059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Terminated: ok {rc=0} 03:00:00.005962 --- ParallelTerminationStrategy: PID 16593 died... 03:00:00.025565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16593): Terminated: ok {rc=0} 03:00:00.113894 bus /gobi_0: Setting Powered False 03:00:01.212805 bus /gobi_0: Setting Powered False 03:00:02.340802 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:03.601562 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:03.605655 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:03.635441 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:00:03.642799 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:03.695253 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:03.725197 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:00:03.732029 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:04.272402 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:04.277485 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:00:04.288755 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:04.338201 tst mo_mt_sms.py: using LAC 25520 03:00:04.463468 tst mo_mt_sms.py: using RAC 20 03:00:04.587968 tst mo_mt_sms.py: using CellId 25520 03:00:04.711807 tst mo_mt_sms.py: using BVCI 25521 03:00:04.828740 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:04.946297 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:05.063810 tst mo_mt_sms.py:9: start nitb and bts... 03:00:05.281110 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:00:05.931349 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16646): Launched 03:00:06.251113 run osmo-nitb_10.42.42.2(pid=16647): Launched 03:00:06.428372 run osmo-nitb_10.42.42.2(pid=16647): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16647)] 03:00:06.572007 run osmo-nitb_10.42.42.2(pid=16647): stdout: | (launched: 2022-12-10_03:00:06.192623) 03:00:06.716415 run osmo-nitb_10.42.42.2(pid=16647): stderr: | (launched: 2022-12-10_03:00:06.240326) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:06.860094 run osmo-nitb_10.42.42.2(pid=16647): stdout: | (launched: 2022-12-10_03:00:06.192623) 03:00:06.998801 run osmo-nitb_10.42.42.2(pid=16647): stderr: | (launched: 2022-12-10_03:00:06.240326) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16647) [trial-2368↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16647)] 03:00:07.371994 tst osmo-nitb_10.42.42.2(pid=16647): stdout: | (launched: 2022-12-10_03:00:06.192623) 03:00:07.500065 tst osmo-nitb_10.42.42.2(pid=16647): stderr: | (launched: 2022-12-10_03:00:06.240326) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:07.652875 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16647) [trial-2368↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16647)] [trial-2368↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 03:00:07.661719 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 03:00:07.668677 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16646): Terminating (SIGTERM) 03:00:07.878936 --- ParallelTerminationStrategy: PID 16646 died... 03:00:07.900636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16646): Terminated: ok {rc=0} 03:00:07.988790 bus /sierra_3: Setting Powered False 03:00:09.089423 bus /sierra_3: Setting Powered False 03:00:10.207009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:11.398731 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:11.402615 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:11.431817 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:00:11.459794 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:11.512574 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:11.543254 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:00:11.570069 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:12.114882 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:12.119747 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.130524 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:12.180806 tst mo_mt_sms.py: using LAC 25521 03:00:12.298665 tst mo_mt_sms.py: using RAC 21 03:00:12.414262 tst mo_mt_sms.py: using CellId 25521 03:00:12.531674 tst mo_mt_sms.py: using BVCI 25522 03:00:12.647040 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.659574 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.671327 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.683081 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.696251 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:12.707521 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:12.826157 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:12.943172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:13.460469 run create_hlr_db(pid=16760): Launched 03:00:13.594890 bus /sierra_2: Setting Powered False 03:00:14.659996 run create_hlr_db(pid=16760): Terminated: ok {rc=0} 03:00:15.105741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17008): Launched 03:00:15.426495 run osmo-hlr_10.42.42.2(pid=17009): Launched 03:00:15.547479 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:16.131178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17011): Launched 03:00:16.463769 run osmo-stp_10.42.42.5(pid=17012): Launched 03:00:16.744652 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:17.530773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Launched 03:00:17.852771 run osmo-msc_10.42.42.6(pid=17015): Launched 03:00:18.030457 run osmo-stp_10.42.42.5(pid=17012): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] 03:00:18.165235 run osmo-stp_10.42.42.5(pid=17012): stdout: | (launched: 2022-12-10_03:00:16.399203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:18.300069 run osmo-stp_10.42.42.5(pid=17012): stderr: | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030016753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:18.434751 run osmo-stp_10.42.42.5(pid=17012): stdout: | (launched: 2022-12-10_03:00:16.399203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:18.561768 run osmo-stp_10.42.42.5(pid=17012): stderr: | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030016752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030016753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030016755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:18.714799 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17012): Process ended prematurely: osmo-stp_10.42.42.5(pid=17012) [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 03:00:18.723343 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 03:00:18.750925 run osmo-hlr_10.42.42.2(pid=17009): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17009)] 03:00:18.801205 run osmo-hlr_10.42.42.2(pid=17009): stdout: | (launched: 2022-12-10_03:00:15.367965) 03:00:18.853291 run osmo-hlr_10.42.42.2(pid=17009): stderr: | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030015565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030015577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030015586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030015586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030015586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:18.925615 run osmo-msc_10.42.42.6(pid=17015): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17015)] 03:00:18.976121 run osmo-msc_10.42.42.6(pid=17015): stdout: | (launched: 2022-12-10_03:00:17.794255) 03:00:19.028127 run osmo-msc_10.42.42.6(pid=17015): stderr: | [0;m[38;5;43m20221210030018118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030018118 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff21e8a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030018118 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030018118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030018119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030018119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030018120 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030018121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030018121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030018121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:19.080760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17008): Terminating (SIGTERM) 03:00:19.122564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17011): Terminating (SIGTERM) 03:00:19.164312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Terminating (SIGTERM) 03:00:19.206538 --- ParallelTerminationStrategy: PID 17008 died... 03:00:19.226737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17008): Terminated: ok {rc=0} 03:00:19.273170 --- ParallelTerminationStrategy: PID 17011 died... 03:00:19.292697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17011): Terminated: ok {rc=0} 03:00:19.338850 --- ParallelTerminationStrategy: PID 17014 died... 03:00:19.358565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Terminated: ok {rc=0} 03:00:19.446037 bus /sierra_3: Setting Powered False 03:00:20.545379 bus /sierra_3: Setting Powered False 03:00:21.663044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:22.895430 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:22.899646 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:22.929979 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:00:22.937041 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:00:22.973580 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:23.003859 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:00:23.011342 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:00:23.537413 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:00:23.543105 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:00:23.555093 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:23.599701 tst assert_extension.py: using LAC 25522 03:00:23.728260 tst assert_extension.py: using RAC 22 03:00:23.850840 tst assert_extension.py: using CellId 25522 03:00:23.976208 tst assert_extension.py: using BVCI 25523 03:00:24.090708 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:00:24.211812 tst assert_extension.py:10: start nitb and bts... 03:00:24.416279 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:00:25.039608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17197): Launched 03:00:25.361096 run osmo-nitb_10.42.42.2(pid=17198): Launched 03:00:25.550234 run osmo-nitb_10.42.42.2(pid=17198): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17198)] 03:00:25.688495 run osmo-nitb_10.42.42.2(pid=17198): stdout: | (launched: 2022-12-10_03:00:25.300099) 03:00:25.827562 run osmo-nitb_10.42.42.2(pid=17198): stderr: | (launched: 2022-12-10_03:00:25.345239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:25.967016 run osmo-nitb_10.42.42.2(pid=17198): stdout: | (launched: 2022-12-10_03:00:25.300099) 03:00:26.101238 run osmo-nitb_10.42.42.2(pid=17198): stderr: | (launched: 2022-12-10_03:00:25.345239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17198): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17198) [trial-2368↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17198)] 03:00:26.495928 tst osmo-nitb_10.42.42.2(pid=17198): stdout: | (launched: 2022-12-10_03:00:25.300099) 03:00:26.619986 tst osmo-nitb_10.42.42.2(pid=17198): stderr: | (launched: 2022-12-10_03:00:25.345239) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:26.767213 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17198): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17198) [trial-2368↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17198)] [trial-2368↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 03:00:26.776365 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:00:26.784243 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17197): Terminating (SIGTERM) 03:00:26.998968 --- ParallelTerminationStrategy: PID 17197 died... 03:00:27.020867 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17197): Terminated: ok {rc=0} 03:00:27.111250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:28.289869 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:28.294503 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:28.326051 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:00:28.356864 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:00:28.393560 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:28.425179 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:00:28.455399 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:00:28.985979 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:00:28.992116 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.004332 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:29.049201 tst assert_extension.py: using LAC 25523 03:00:29.175486 tst assert_extension.py: using RAC 23 03:00:29.299482 tst assert_extension.py: using CellId 25523 03:00:29.423296 tst assert_extension.py: using BVCI 25524 03:00:29.539357 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.550706 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.561909 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.573237 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.584249 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:29.595555 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:00:29.710272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:30.208219 run create_hlr_db(pid=17203): Launched 03:00:30.339031 bus /sierra_2: Setting Powered False 03:00:31.402379 run create_hlr_db(pid=17203): Terminated: ok {rc=0} 03:00:31.861705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Launched 03:00:32.199899 run osmo-hlr_10.42.42.2(pid=17206): Launched 03:00:32.323527 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:32.880165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Launched 03:00:33.201325 run osmo-stp_10.42.42.5(pid=17209): Launched 03:00:33.324177 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:33.901796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Launched 03:00:34.222081 run osmo-msc_10.42.42.6(pid=17212): Launched 03:00:34.400189 run osmo-stp_10.42.42.5(pid=17209): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] 03:00:34.534963 run osmo-stp_10.42.42.5(pid=17209): stdout: | (launched: 2022-12-10_03:00:33.142694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:34.671283 run osmo-stp_10.42.42.5(pid=17209): stderr: | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030033337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:34.806417 run osmo-stp_10.42.42.5(pid=17209): stdout: | (launched: 2022-12-10_03:00:33.142694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:34.933236 run osmo-stp_10.42.42.5(pid=17209): stderr: | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030033336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030033337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030033337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:35.085234 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17209): Process ended prematurely: osmo-stp_10.42.42.5(pid=17209) [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 03:00:35.093822 tst assert_extension.py:17: Test FAILED (6.1 sec) 03:00:35.121028 run osmo-hlr_10.42.42.2(pid=17206): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17206)] 03:00:35.171206 run osmo-hlr_10.42.42.2(pid=17206): stdout: | (launched: 2022-12-10_03:00:32.141312) 03:00:35.222646 run osmo-hlr_10.42.42.2(pid=17206): stderr: | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030032337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030032350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030032358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030032359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030032359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:35.294461 run osmo-msc_10.42.42.6(pid=17212): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17212)] 03:00:35.344272 run osmo-msc_10.42.42.6(pid=17212): stdout: | (launched: 2022-12-10_03:00:34.163488) 03:00:35.395677 run osmo-msc_10.42.42.6(pid=17212): stderr: | [0;m[38;5;43m20221210030034486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030034487 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f888fd31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030034487 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030034487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030034487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030034487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030034489 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030034489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030034489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030034490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:35.447593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Terminating (SIGTERM) 03:00:35.488988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Terminating (SIGTERM) 03:00:35.530774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Terminating (SIGTERM) 03:00:35.572408 --- ParallelTerminationStrategy: PID 17205 died... 03:00:35.592259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Terminated: ok {rc=0} 03:00:35.638249 --- ParallelTerminationStrategy: PID 17208 died... 03:00:35.657854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Terminated: ok {rc=0} 03:00:35.703673 --- ParallelTerminationStrategy: PID 17211 died... 03:00:35.723272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Terminated: ok {rc=0} 03:00:35.810642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:00:37.016057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:37.024424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:00:37.054675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:00:37.082046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:00:37.134699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:00:37.164335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:00:37.191822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:00:37.747018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:00:37.799548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:37.811236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:00:37.877366 tst mo_mt_call.py: using LAC 25524 03:00:38.003266 tst mo_mt_call.py: using RAC 24 03:00:38.129892 tst mo_mt_call.py: using CellId 25524 03:00:38.250909 tst mo_mt_call.py: using BVCI 25525 03:00:38.364401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:38.375911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:38.387231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:38.398580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:38.410255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:38.421488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:38.542879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:38.663239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:39.170332 run create_hlr_db(pid=17217): Launched 03:00:39.302993 bus /sierra_2: Setting Powered False 03:00:40.367129 run create_hlr_db(pid=17217): Terminated: ok {rc=0} 03:00:40.804176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Launched 03:00:41.111671 run osmo-hlr_10.42.42.2(pid=17220): Launched 03:00:41.227743 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:41.756180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Launched 03:00:42.061415 run osmo-stp_10.42.42.5(pid=17223): Launched 03:00:42.180779 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:42.745583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Launched 03:00:43.052108 run osmo-msc_10.42.42.6(pid=17226): Launched 03:00:43.223709 run osmo-stp_10.42.42.5(pid=17223): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] 03:00:43.353759 run osmo-stp_10.42.42.5(pid=17223): stdout: | (launched: 2022-12-10_03:00:42.004906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:43.482800 run osmo-stp_10.42.42.5(pid=17223): stderr: | [0;m[38;5;43m20221210030042179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030042179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030042180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030042180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030042180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030042181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030042181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:43.610180 run osmo-stp_10.42.42.5(pid=17223): stdout: | (launched: 2022-12-10_03:00:42.004906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:43.731288 run osmo-stp_10.42.42.5(pid=17223): stderr: | [0;m[38;5;43m20221210030042179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030042179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030042180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030042180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030042180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030042181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030042181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:43.875891 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17223): Process ended prematurely: osmo-stp_10.42.42.5(pid=17223) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:00:43.884854 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:00:43.911744 run osmo-hlr_10.42.42.2(pid=17220): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17220)] 03:00:43.959563 run osmo-hlr_10.42.42.2(pid=17220): stdout: | (launched: 2022-12-10_03:00:41.055238) 03:00:44.008786 run osmo-hlr_10.42.42.2(pid=17220): stderr: | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030041231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030041243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030041253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030041253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030041253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:44.077904 run osmo-msc_10.42.42.6(pid=17226): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17226)] 03:00:44.125446 run osmo-msc_10.42.42.6(pid=17226): stdout: | (launched: 2022-12-10_03:00:42.995716) 03:00:44.174496 run osmo-msc_10.42.42.6(pid=17226): stderr: | [0;m[38;5;43m20221210030043267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030043267 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd308a0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030043267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030043267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030043267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030043267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030043269 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030043270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030043270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030043270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:44.223859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Terminating (SIGTERM) 03:00:44.263157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Terminating (SIGTERM) 03:00:44.302706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Terminating (SIGTERM) 03:00:44.342679 --- ParallelTerminationStrategy: PID 17219 died... 03:00:44.361725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Terminated: ok {rc=0} 03:00:44.405520 --- ParallelTerminationStrategy: PID 17222 died... 03:00:44.424246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Terminated: ok {rc=0} 03:00:44.469055 --- ParallelTerminationStrategy: PID 17225 died... 03:00:44.487732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Terminated: ok {rc=0} 03:00:44.570691 bus /sierra_3: Setting Powered False 03:00:45.665935 bus /sierra_3: Setting Powered False 03:00:46.785132 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:00:47.947707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:47.960228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:00:48.026632 tst mo_mt_call_osmux.py: using LAC 25525 03:00:48.153724 tst mo_mt_call_osmux.py: using RAC 25 03:00:48.279839 tst mo_mt_call_osmux.py: using CellId 25525 03:00:48.406506 tst mo_mt_call_osmux.py: using BVCI 25526 03:00:48.525607 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:48.537593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:48.549053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:48.560611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:48.572477 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:48.584147 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:48.705647 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:48.826707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:49.332865 run create_hlr_db(pid=17228): Launched 03:00:49.469096 bus /sierra_2: Setting Powered False 03:00:50.533911 run create_hlr_db(pid=17228): Terminated: ok {rc=0} 03:00:50.968827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17230): Launched 03:00:51.274013 run osmo-hlr_10.42.42.2(pid=17231): Launched 03:00:51.391320 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:51.914571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17233): Launched 03:00:52.219221 run osmo-stp_10.42.42.5(pid=17234): Launched 03:00:52.334867 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:52.889960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17236): Launched 03:00:53.195395 run osmo-msc_10.42.42.6(pid=17237): Launched 03:00:53.366231 run osmo-stp_10.42.42.5(pid=17234): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17234)] 03:00:53.495848 run osmo-stp_10.42.42.5(pid=17234): stdout: | (launched: 2022-12-10_03:00:52.163382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:53.625570 run osmo-stp_10.42.42.5(pid=17234): stderr: | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030052335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:53.753187 run osmo-stp_10.42.42.5(pid=17234): stdout: | (launched: 2022-12-10_03:00:52.163382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:53.874109 run osmo-stp_10.42.42.5(pid=17234): stderr: | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030052334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030052335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030052335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:54.019135 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17234): Process ended prematurely: osmo-stp_10.42.42.5(pid=17234) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17234)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:00:54.027813 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:00:54.055119 run osmo-hlr_10.42.42.2(pid=17231): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17231)] 03:00:54.103225 run osmo-hlr_10.42.42.2(pid=17231): stdout: | (launched: 2022-12-10_03:00:51.218199) 03:00:54.152581 run osmo-hlr_10.42.42.2(pid=17231): stderr: | [0;m[1;31m20221210030051394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030051395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030051395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030051395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030051395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030051395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030051423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030051434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030051434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030051434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:54.221636 run osmo-msc_10.42.42.6(pid=17237): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17237)] 03:00:54.269436 run osmo-msc_10.42.42.6(pid=17237): stdout: | (launched: 2022-12-10_03:00:53.139292) 03:00:54.318858 run osmo-msc_10.42.42.6(pid=17237): stderr: | [0;m[38;5;43m20221210030053411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030053411 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff95080c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030053411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030053411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030053411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030053411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030053415 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030053415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:54.368683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17230): Terminating (SIGTERM) 03:00:54.408572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17233): Terminating (SIGTERM) 03:00:54.448429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17236): Terminating (SIGTERM) 03:00:54.489137 --- ParallelTerminationStrategy: PID 17230 died... 03:00:54.508296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17230): Terminated: ok {rc=0} 03:00:54.552883 --- ParallelTerminationStrategy: PID 17233 died... 03:00:54.571822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17233): Terminated: ok {rc=0} 03:00:54.616558 --- ParallelTerminationStrategy: PID 17236 died... 03:00:54.635495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17236): Terminated: ok {rc=0} 03:00:54.719969 bus /sierra_3: Setting Powered False 03:00:55.818472 bus /sierra_3: Setting Powered False 03:00:56.937093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:00:58.185878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:58.192851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:00:58.222911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:00:58.250117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:00:58.302357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:00:58.332266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:00:58.359654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:00:58.915164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:00:58.967677 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:58.979536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:00:59.045368 tst mo_mt_call.py: using LAC 25526 03:00:59.172415 tst mo_mt_call.py: using RAC 26 03:00:59.299718 tst mo_mt_call.py: using CellId 25526 03:00:59.426772 tst mo_mt_call.py: using BVCI 25527 03:00:59.546023 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:59.557884 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:59.569489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:59.581200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:59.592793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:00:59.604631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:00:59.723410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:00:59.839927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:00.313816 run create_hlr_db(pid=17242): Launched 03:01:00.431741 bus /sierra_2: Setting Powered False 03:01:01.512305 run create_hlr_db(pid=17242): Terminated: ok {rc=0} 03:01:02.001653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17244): Launched 03:01:02.344346 run osmo-hlr_10.42.42.2(pid=17245): Launched 03:01:02.470432 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:03.022728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17247): Launched 03:01:03.329622 run osmo-stp_10.42.42.5(pid=17248): Launched 03:01:03.447457 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:04.003354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17250): Launched 03:01:04.311243 run osmo-msc_10.42.42.6(pid=17251): Launched 03:01:04.483933 run osmo-stp_10.42.42.5(pid=17248): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17248)] 03:01:04.614443 run osmo-stp_10.42.42.5(pid=17248): stdout: | (launched: 2022-12-10_03:01:03.273176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:04.744016 run osmo-stp_10.42.42.5(pid=17248): stderr: | [0;m[38;5;43m20221210030103446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030103447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030103447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030103447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:04.871819 run osmo-stp_10.42.42.5(pid=17248): stdout: | (launched: 2022-12-10_03:01:03.273176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:04.993162 run osmo-stp_10.42.42.5(pid=17248): stderr: | [0;m[38;5;43m20221210030103446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030103447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030103447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030103447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030103448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:05.139085 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17248): Process ended prematurely: osmo-stp_10.42.42.5(pid=17248) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17248)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:01:05.148043 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:01:05.175465 run osmo-hlr_10.42.42.2(pid=17245): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17245)] 03:01:05.223589 run osmo-hlr_10.42.42.2(pid=17245): stdout: | (launched: 2022-12-10_03:01:02.284880) 03:01:05.273420 run osmo-hlr_10.42.42.2(pid=17245): stderr: | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030102485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030102498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030102506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030102506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030102506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:05.343100 run osmo-msc_10.42.42.6(pid=17251): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17251)] 03:01:05.391175 run osmo-msc_10.42.42.6(pid=17251): stdout: | (launched: 2022-12-10_03:01:04.254394) 03:01:05.440652 run osmo-msc_10.42.42.6(pid=17251): stderr: | [0;m[38;5;43m20221210030104526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030104526 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02f6a33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030104526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030104526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030104526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030104527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030104528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030104529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030104529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030104529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:05.490621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17244): Terminating (SIGTERM) 03:01:05.530711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17247): Terminating (SIGTERM) 03:01:05.570924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17250): Terminating (SIGTERM) 03:01:05.612015 --- ParallelTerminationStrategy: PID 17244 died... 03:01:05.631133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17244): Terminated: ok {rc=0} 03:01:05.675419 --- ParallelTerminationStrategy: PID 17247 died... 03:01:05.694023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17247): Terminated: ok {rc=0} 03:01:05.738254 --- ParallelTerminationStrategy: PID 17250 died... 03:01:05.756868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17250): Terminated: ok {rc=0} 03:01:05.841634 bus /sierra_3: Setting Powered False 03:01:06.941273 bus /sierra_3: Setting Powered False 03:01:08.058305 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:01:09.202167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.214209 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:01:09.281459 tst mo_mt_call_osmux.py: using LAC 25527 03:01:09.404734 tst mo_mt_call_osmux.py: using RAC 27 03:01:09.526486 tst mo_mt_call_osmux.py: using CellId 25527 03:01:09.651865 tst mo_mt_call_osmux.py: using BVCI 25528 03:01:09.764628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.776008 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.787169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.798534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.809981 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:09.821379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:09.943789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:10.065867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:10.574555 run create_hlr_db(pid=17253): Launched 03:01:10.708617 bus /sierra_2: Setting Powered False 03:01:11.773717 run create_hlr_db(pid=17253): Terminated: ok {rc=0} 03:01:12.226926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17255): Launched 03:01:12.553367 run osmo-hlr_10.42.42.2(pid=17256): Launched 03:01:12.678688 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:13.241540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17258): Launched 03:01:13.569455 run osmo-stp_10.42.42.5(pid=17259): Launched 03:01:13.695479 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:14.289794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17261): Launched 03:01:14.618087 run osmo-msc_10.42.42.6(pid=17262): Launched 03:01:14.802236 run osmo-stp_10.42.42.5(pid=17259): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17259)] 03:01:14.940105 run osmo-stp_10.42.42.5(pid=17259): stdout: | (launched: 2022-12-10_03:01:13.509532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:15.078981 run osmo-stp_10.42.42.5(pid=17259): stderr: | [0;m[38;5;43m20221210030113702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030113702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030113703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030113703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:15.217299 run osmo-stp_10.42.42.5(pid=17259): stdout: | (launched: 2022-12-10_03:01:13.509532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:15.346871 run osmo-stp_10.42.42.5(pid=17259): stderr: | [0;m[38;5;43m20221210030113702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030113702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030113703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030113703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030113705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:15.502460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17259): Process ended prematurely: osmo-stp_10.42.42.5(pid=17259) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17259)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:01:15.511835 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:01:15.539656 run osmo-hlr_10.42.42.2(pid=17256): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17256)] 03:01:15.589404 run osmo-hlr_10.42.42.2(pid=17256): stdout: | (launched: 2022-12-10_03:01:12.493790) 03:01:15.641370 run osmo-hlr_10.42.42.2(pid=17256): stderr: | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030112696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030112708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030112716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030112717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030112717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:15.713481 run osmo-msc_10.42.42.6(pid=17262): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17262)] 03:01:15.763141 run osmo-msc_10.42.42.6(pid=17262): stdout: | (launched: 2022-12-10_03:01:14.557899) 03:01:15.814388 run osmo-msc_10.42.42.6(pid=17262): stderr: | [0;m[38;5;43m20221210030114882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030114882 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48e945ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030114882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030114882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030114882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030114882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030114884 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030114884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030114884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030114885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:15.866293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17255): Terminating (SIGTERM) 03:01:15.913038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17258): Terminating (SIGTERM) 03:01:15.962297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17261): Terminating (SIGTERM) 03:01:16.008020 --- ParallelTerminationStrategy: PID 17255 died... 03:01:16.028061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17255): Terminated: ok {rc=0} 03:01:16.098337 --- ParallelTerminationStrategy: PID 17258 died... 03:01:16.123220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17258): Terminated: ok {rc=0} 03:01:16.181757 --- ParallelTerminationStrategy: PID 17261 died... 03:01:16.206191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17261): Terminated: ok {rc=0} 03:01:16.314077 bus /sierra_3: Setting Powered False 03:01:17.421859 bus /sierra_3: Setting Powered False 03:01:18.537359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:01:19.794942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:19.802995 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:01:19.833284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:01:19.860422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:01:19.911729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:01:19.941421 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:01:19.968736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:01:20.524189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:01:20.576235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:20.588047 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:01:20.654205 tst mo_mt_call.py: using LAC 25528 03:01:20.791461 tst mo_mt_call.py: using RAC 28 03:01:20.925616 tst mo_mt_call.py: using CellId 25528 03:01:21.046188 tst mo_mt_call.py: using BVCI 25529 03:01:21.160141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:21.171715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:21.182987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:21.194603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:21.206403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:21.218217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:21.334141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:21.449767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:21.925967 run create_hlr_db(pid=17268): Launched 03:01:22.043486 bus /sierra_2: Setting Powered False 03:01:23.104548 run create_hlr_db(pid=17268): Terminated: ok {rc=0} 03:01:23.552522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17270): Launched 03:01:23.881966 run osmo-hlr_10.42.42.2(pid=17271): Launched 03:01:24.008039 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:24.549262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17273): Launched 03:01:24.855978 run osmo-stp_10.42.42.5(pid=17274): Launched 03:01:24.973176 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:25.530262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17276): Launched 03:01:25.837924 run osmo-msc_10.42.42.6(pid=17277): Launched 03:01:26.011115 run osmo-stp_10.42.42.5(pid=17274): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17274)] 03:01:26.142910 run osmo-stp_10.42.42.5(pid=17274): stdout: | (launched: 2022-12-10_03:01:24.799443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:26.273778 run osmo-stp_10.42.42.5(pid=17274): stderr: | [0;m[38;5;43m20221210030124970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030124971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030124971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030124971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030124973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030124974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030124974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:26.403227 run osmo-stp_10.42.42.5(pid=17274): stdout: | (launched: 2022-12-10_03:01:24.799443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:26.525271 run osmo-stp_10.42.42.5(pid=17274): stderr: | [0;m[38;5;43m20221210030124970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030124971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030124971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030124971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030124973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030124974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030124974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:26.671837 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17274): Process ended prematurely: osmo-stp_10.42.42.5(pid=17274) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17274)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:01:26.680921 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:01:26.707784 run osmo-hlr_10.42.42.2(pid=17271): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17271)] 03:01:26.755880 run osmo-hlr_10.42.42.2(pid=17271): stdout: | (launched: 2022-12-10_03:01:23.821884) 03:01:26.805329 run osmo-hlr_10.42.42.2(pid=17271): stderr: | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030124023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030124036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030124044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030124044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030124044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:26.874921 run osmo-msc_10.42.42.6(pid=17277): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17277)] 03:01:26.922685 run osmo-msc_10.42.42.6(pid=17277): stdout: | (launched: 2022-12-10_03:01:25.780906) 03:01:26.972154 run osmo-msc_10.42.42.6(pid=17277): stderr: | [0;m[38;5;43m20221210030126051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030126051 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf015f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030126051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030126051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030126051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030126051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030126053 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030126054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030126054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030126054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:27.021926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17270): Terminating (SIGTERM) 03:01:27.061777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17273): Terminating (SIGTERM) 03:01:27.101625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17276): Terminating (SIGTERM) 03:01:27.142423 --- ParallelTerminationStrategy: PID 17270 died... 03:01:27.161728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17270): Terminated: ok {rc=0} 03:01:27.206551 --- ParallelTerminationStrategy: PID 17273 died... 03:01:27.225486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17273): Terminated: ok {rc=0} 03:01:27.269902 --- ParallelTerminationStrategy: PID 17276 died... 03:01:27.288654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17276): Terminated: ok {rc=0} 03:01:27.374740 bus /sierra_3: Setting Powered False 03:01:28.474411 bus /sierra_3: Setting Powered False 03:01:29.587775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:01:30.737429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:30.749810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:01:30.820676 tst mo_mt_call_osmux.py: using LAC 25529 03:01:30.968664 tst mo_mt_call_osmux.py: using RAC 29 03:01:31.100403 tst mo_mt_call_osmux.py: using CellId 25529 03:01:31.244464 tst mo_mt_call_osmux.py: using BVCI 25530 03:01:31.359154 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:31.371784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:31.383967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:31.397261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:31.411615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:31.426065 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:31.561063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:31.690434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:32.184566 run create_hlr_db(pid=17279): Launched 03:01:32.307085 bus /sierra_2: Setting Powered False 03:01:33.367966 run create_hlr_db(pid=17279): Terminated: ok {rc=0} 03:01:33.816746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Launched 03:01:34.144329 run osmo-hlr_10.42.42.2(pid=17282): Launched 03:01:34.269533 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:34.838628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Launched 03:01:35.165433 run osmo-stp_10.42.42.5(pid=17285): Launched 03:01:35.291637 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:35.883701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Launched 03:01:36.210336 run osmo-msc_10.42.42.6(pid=17288): Launched 03:01:36.392302 run osmo-stp_10.42.42.5(pid=17285): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] 03:01:36.529263 run osmo-stp_10.42.42.5(pid=17285): stdout: | (launched: 2022-12-10_03:01:35.105705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:36.667556 run osmo-stp_10.42.42.5(pid=17285): stderr: | [0;m[38;5;43m20221210030135300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030135301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030135301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030135301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:36.804395 run osmo-stp_10.42.42.5(pid=17285): stdout: | (launched: 2022-12-10_03:01:35.105705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:36.933546 run osmo-stp_10.42.42.5(pid=17285): stderr: | [0;m[38;5;43m20221210030135300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030135301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030135301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030135301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030135302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:37.088088 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17285): Process ended prematurely: osmo-stp_10.42.42.5(pid=17285) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:01:37.097616 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:01:37.125380 run osmo-hlr_10.42.42.2(pid=17282): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17282)] 03:01:37.175213 run osmo-hlr_10.42.42.2(pid=17282): stdout: | (launched: 2022-12-10_03:01:34.084634) 03:01:37.226627 run osmo-hlr_10.42.42.2(pid=17282): stderr: | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030134287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030134300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030134310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030134310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030134310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:37.299273 run osmo-msc_10.42.42.6(pid=17288): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17288)] 03:01:37.349229 run osmo-msc_10.42.42.6(pid=17288): stdout: | (launched: 2022-12-10_03:01:36.150587) 03:01:37.400831 run osmo-msc_10.42.42.6(pid=17288): stderr: | [0;m[38;5;43m20221210030136476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030136476 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f63a13b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030136477 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030136477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030136477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030136477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030136479 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030136479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030136479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030136479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:37.452706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Terminating (SIGTERM) 03:01:37.494175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Terminating (SIGTERM) 03:01:37.535584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Terminating (SIGTERM) 03:01:37.577344 --- ParallelTerminationStrategy: PID 17281 died... 03:01:37.597462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Terminated: ok {rc=0} 03:01:37.643525 --- ParallelTerminationStrategy: PID 17284 died... 03:01:37.663187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Terminated: ok {rc=0} 03:01:37.708894 --- ParallelTerminationStrategy: PID 17287 died... 03:01:37.728437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Terminated: ok {rc=0} 03:01:37.815787 bus /sierra_3: Setting Powered False 03:01:38.915427 bus /sierra_3: Setting Powered False 03:01:40.030805 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:01:41.273233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:41.279500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:01:41.309744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:01:41.336913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:01:41.390720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:01:41.421311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:01:41.447695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:01:41.996310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:01:42.045812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.057280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:01:42.123087 tst mo_mt_call.py: using LAC 25530 03:01:42.243512 tst mo_mt_call.py: using RAC 30 03:01:42.372818 tst mo_mt_call.py: using CellId 25530 03:01:42.502841 tst mo_mt_call.py: using BVCI 25531 03:01:42.621820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.634218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.646185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.658038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.669787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:42.681492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:42.799267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:42.915141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:43.389154 run create_hlr_db(pid=17293): Launched 03:01:43.507157 bus /sierra_2: Setting Powered False 03:01:44.567912 run create_hlr_db(pid=17293): Terminated: ok {rc=0} 03:01:44.993174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17295): Launched 03:01:45.299820 run osmo-hlr_10.42.42.2(pid=17296): Launched 03:01:45.418475 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:45.973832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17298): Launched 03:01:46.381072 run osmo-stp_10.42.42.5(pid=17299): Launched 03:01:46.555364 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:47.322973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17301): Launched 03:01:47.631921 run osmo-msc_10.42.42.6(pid=17302): Launched 03:01:47.804732 run osmo-stp_10.42.42.5(pid=17299): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17299)] 03:01:47.935118 run osmo-stp_10.42.42.5(pid=17299): stdout: | (launched: 2022-12-10_03:01:46.320295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:48.065350 run osmo-stp_10.42.42.5(pid=17299): stderr: | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030146664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:48.193719 run osmo-stp_10.42.42.5(pid=17299): stdout: | (launched: 2022-12-10_03:01:46.320295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:48.314772 run osmo-stp_10.42.42.5(pid=17299): stderr: | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030146663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030146664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:48.460060 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17299): Process ended prematurely: osmo-stp_10.42.42.5(pid=17299) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17299)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:01:48.468940 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:01:48.496089 run osmo-hlr_10.42.42.2(pid=17296): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17296)] 03:01:48.543756 run osmo-hlr_10.42.42.2(pid=17296): stdout: | (launched: 2022-12-10_03:01:45.243474) 03:01:48.593402 run osmo-hlr_10.42.42.2(pid=17296): stderr: | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030145422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030145435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030145444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030145444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030145444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:48.662669 run osmo-msc_10.42.42.6(pid=17302): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17302)] 03:01:48.710788 run osmo-msc_10.42.42.6(pid=17302): stdout: | (launched: 2022-12-10_03:01:47.575146) 03:01:48.760319 run osmo-msc_10.42.42.6(pid=17302): stderr: | [0;m[38;5;43m20221210030147847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030147847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa37c4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030147847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030147847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030147847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030147847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030147849 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030147850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030147850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030147850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:48.810278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17295): Terminating (SIGTERM) 03:01:48.850009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17298): Terminating (SIGTERM) 03:01:48.889940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17301): Terminating (SIGTERM) 03:01:48.930202 --- ParallelTerminationStrategy: PID 17295 died... 03:01:48.949470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17295): Terminated: ok {rc=0} 03:01:48.993945 --- ParallelTerminationStrategy: PID 17298 died... 03:01:49.012727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17298): Terminated: ok {rc=0} 03:01:49.057162 --- ParallelTerminationStrategy: PID 17301 died... 03:01:49.075895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17301): Terminated: ok {rc=0} 03:01:49.162427 bus /sierra_3: Setting Powered False 03:01:50.262932 bus /sierra_3: Setting Powered False 03:01:51.379452 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:01:52.527086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:52.539105 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:01:52.605123 tst mo_mt_call_osmux.py: using LAC 25531 03:01:52.725638 tst mo_mt_call_osmux.py: using RAC 31 03:01:52.856058 tst mo_mt_call_osmux.py: using CellId 25531 03:01:52.983832 tst mo_mt_call_osmux.py: using BVCI 25532 03:01:53.103050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:53.115052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:53.126806 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:53.138595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:53.150412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:53.161960 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:53.282917 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:53.400001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:53.873735 run create_hlr_db(pid=17304): Launched 03:01:53.990497 bus /sierra_2: Setting Powered False 03:01:55.050908 run create_hlr_db(pid=17304): Terminated: ok {rc=0} 03:01:55.497219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17306): Launched 03:01:55.824558 run osmo-hlr_10.42.42.2(pid=17307): Launched 03:01:55.949727 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:56.515953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17309): Launched 03:01:56.843779 run osmo-stp_10.42.42.5(pid=17310): Launched 03:01:56.967648 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:57.558705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17312): Launched 03:01:57.885525 run osmo-msc_10.42.42.6(pid=17313): Launched 03:01:58.068893 run osmo-stp_10.42.42.5(pid=17310): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17310)] 03:01:58.206642 run osmo-stp_10.42.42.5(pid=17310): stdout: | (launched: 2022-12-10_03:01:56.783290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:58.345463 run osmo-stp_10.42.42.5(pid=17310): stderr: | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030156975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:58.482851 run osmo-stp_10.42.42.5(pid=17310): stdout: | (launched: 2022-12-10_03:01:56.783290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:58.612205 run osmo-stp_10.42.42.5(pid=17310): stderr: | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030156975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030156975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030156976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:58.768227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17310): Process ended prematurely: osmo-stp_10.42.42.5(pid=17310) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17310)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:01:58.777686 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:01:58.805372 run osmo-hlr_10.42.42.2(pid=17307): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17307)] 03:01:58.855055 run osmo-hlr_10.42.42.2(pid=17307): stdout: | (launched: 2022-12-10_03:01:55.765117) 03:01:58.906813 run osmo-hlr_10.42.42.2(pid=17307): stderr: | [0;m[1;31m20221210030155962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030155962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030155962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030155962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030155963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030155963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030155975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030155984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030155984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030155984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:58.979390 run osmo-msc_10.42.42.6(pid=17313): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17313)] 03:01:59.029343 run osmo-msc_10.42.42.6(pid=17313): stdout: | (launched: 2022-12-10_03:01:57.825617) 03:01:59.080756 run osmo-msc_10.42.42.6(pid=17313): stderr: | [0;m[38;5;43m20221210030158148 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030158148 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15089bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030158149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030158149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030158149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030158149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030158151 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030158151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030158151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030158151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:59.132421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17306): Terminating (SIGTERM) 03:01:59.173832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17309): Terminating (SIGTERM) 03:01:59.217666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17312): Terminating (SIGTERM) 03:01:59.258517 --- ParallelTerminationStrategy: PID 17306 died... 03:01:59.277462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17306): Terminated: ok {rc=0} 03:01:59.322195 --- ParallelTerminationStrategy: PID 17309 died... 03:01:59.341154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17309): Terminated: ok {rc=0} 03:01:59.385705 --- ParallelTerminationStrategy: PID 17312 died... 03:01:59.404584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17312): Terminated: ok {rc=0} 03:01:59.492140 bus /sierra_3: Setting Powered False 03:02:00.589424 bus /sierra_3: Setting Powered False 03:02:01.704928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:02:02.952879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:02.959368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:02:02.989324 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:02:03.016208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:02:03.067244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:02:03.096137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:02:03.122640 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:02:03.679599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:02:03.729598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:03.740907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:03.827592 tst mo_mt_call.py: using LAC 25532 03:02:03.947105 tst mo_mt_call.py: using RAC 32 03:02:04.069621 tst mo_mt_call.py: using CellId 25532 03:02:04.199514 tst mo_mt_call.py: using BVCI 25533 03:02:04.319569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:04.331409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:04.343213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:04.355533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:04.367666 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:04.379586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:04.502597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:04.620549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:05.097300 run create_hlr_db(pid=17318): Launched 03:02:05.232365 bus /sierra_2: Setting Powered False 03:02:06.296906 run create_hlr_db(pid=17318): Terminated: ok {rc=0} 03:02:06.750398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Launched 03:02:07.076905 run osmo-hlr_10.42.42.2(pid=17321): Launched 03:02:07.202510 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:07.764159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Launched 03:02:08.090201 run osmo-stp_10.42.42.5(pid=17324): Launched 03:02:08.214775 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:08.804081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Launched 03:02:09.130720 run osmo-msc_10.42.42.6(pid=17327): Launched 03:02:09.312683 run osmo-stp_10.42.42.5(pid=17324): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] 03:02:09.449768 run osmo-stp_10.42.42.5(pid=17324): stdout: | (launched: 2022-12-10_03:02:08.030592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:09.588019 run osmo-stp_10.42.42.5(pid=17324): stderr: | [0;m[38;5;43m20221210030208222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030208222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030208223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030208223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030208223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030208224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030208224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:09.725632 run osmo-stp_10.42.42.5(pid=17324): stdout: | (launched: 2022-12-10_03:02:08.030592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:09.854626 run osmo-stp_10.42.42.5(pid=17324): stderr: | [0;m[38;5;43m20221210030208222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030208222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030208223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030208223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030208223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030208224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030208224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:10.009093 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17324): Process ended prematurely: osmo-stp_10.42.42.5(pid=17324) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:02:10.018527 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:02:10.046337 run osmo-hlr_10.42.42.2(pid=17321): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17321)] 03:02:10.096303 run osmo-hlr_10.42.42.2(pid=17321): stdout: | (launched: 2022-12-10_03:02:07.017555) 03:02:10.147752 run osmo-hlr_10.42.42.2(pid=17321): stderr: | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030207218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030207231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030207239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030207239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030207239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:10.220226 run osmo-msc_10.42.42.6(pid=17327): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17327)] 03:02:10.270191 run osmo-msc_10.42.42.6(pid=17327): stdout: | (launched: 2022-12-10_03:02:09.070899) 03:02:10.321656 run osmo-msc_10.42.42.6(pid=17327): stderr: | [0;m[38;5;43m20221210030209393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030209394 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2be7098c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030209394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030209394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030209394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030209394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030209397 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030209398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030209398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030209398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:10.373606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Terminating (SIGTERM) 03:02:10.415204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Terminating (SIGTERM) 03:02:10.456582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Terminating (SIGTERM) 03:02:10.498515 --- ParallelTerminationStrategy: PID 17320 died... 03:02:10.518146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Terminated: ok {rc=0} 03:02:10.564292 --- ParallelTerminationStrategy: PID 17323 died... 03:02:10.583957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Terminated: ok {rc=0} 03:02:10.629876 --- ParallelTerminationStrategy: PID 17326 died... 03:02:10.649811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Terminated: ok {rc=0} 03:02:10.738226 bus /sierra_3: Setting Powered False 03:02:11.837856 bus /sierra_3: Setting Powered False 03:02:12.952739 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:02:14.101757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.114040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:14.181876 tst mo_mt_call_osmux.py: using LAC 25533 03:02:14.311548 tst mo_mt_call_osmux.py: using RAC 33 03:02:14.440632 tst mo_mt_call_osmux.py: using CellId 25533 03:02:14.569173 tst mo_mt_call_osmux.py: using BVCI 25534 03:02:14.689498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.701434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.713087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.724619 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.736335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:14.747883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:14.867365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:14.987948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:15.495002 run create_hlr_db(pid=17329): Launched 03:02:15.628499 bus /sierra_2: Setting Powered False 03:02:16.693658 run create_hlr_db(pid=17329): Terminated: ok {rc=0} 03:02:17.157291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17331): Launched 03:02:17.495339 run osmo-hlr_10.42.42.2(pid=17332): Launched 03:02:17.621499 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:18.187577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17334): Launched 03:02:18.513291 run osmo-stp_10.42.42.5(pid=17335): Launched 03:02:18.637560 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:19.227404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17337): Launched 03:02:19.554102 run osmo-msc_10.42.42.6(pid=17338): Launched 03:02:19.738469 run osmo-stp_10.42.42.5(pid=17335): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17335)] 03:02:19.876662 run osmo-stp_10.42.42.5(pid=17335): stdout: | (launched: 2022-12-10_03:02:18.453718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:20.014660 run osmo-stp_10.42.42.5(pid=17335): stderr: | [0;m[38;5;43m20221210030218648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030218648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030218649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030218649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:20.151665 run osmo-stp_10.42.42.5(pid=17335): stdout: | (launched: 2022-12-10_03:02:18.453718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:20.280559 run osmo-stp_10.42.42.5(pid=17335): stderr: | [0;m[38;5;43m20221210030218648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030218648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030218649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030218649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030218650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:20.435453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17335): Process ended prematurely: osmo-stp_10.42.42.5(pid=17335) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17335)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:02:20.444754 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:02:20.472556 run osmo-hlr_10.42.42.2(pid=17332): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17332)] 03:02:20.522157 run osmo-hlr_10.42.42.2(pid=17332): stdout: | (launched: 2022-12-10_03:02:17.435397) 03:02:20.573476 run osmo-hlr_10.42.42.2(pid=17332): stderr: | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030217634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030217647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030217657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030217658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030217658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:20.645786 run osmo-msc_10.42.42.6(pid=17338): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17338)] 03:02:20.695408 run osmo-msc_10.42.42.6(pid=17338): stdout: | (launched: 2022-12-10_03:02:19.494136) 03:02:20.746476 run osmo-msc_10.42.42.6(pid=17338): stderr: | [0;m[38;5;43m20221210030219817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030219817 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1726bd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030219818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030219818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030219818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030219818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030219820 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030219820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030219820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030219820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:20.798032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17331): Terminating (SIGTERM) 03:02:20.839283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17334): Terminating (SIGTERM) 03:02:20.880667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17337): Terminating (SIGTERM) 03:02:20.922910 --- ParallelTerminationStrategy: PID 17331 died... 03:02:20.942822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17331): Terminated: ok {rc=0} 03:02:20.988458 --- ParallelTerminationStrategy: PID 17334 died... 03:02:21.007899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17334): Terminated: ok {rc=0} 03:02:21.053290 --- ParallelTerminationStrategy: PID 17337 died... 03:02:21.072506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17337): Terminated: ok {rc=0} 03:02:21.159111 bus /sierra_3: Setting Powered False 03:02:22.258426 bus /sierra_3: Setting Powered False 03:02:23.375007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:02:24.622920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:24.631278 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:02:24.661808 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:02:24.689406 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:02:24.743243 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:02:24.773181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:02:24.800480 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:02:25.355136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:02:25.407443 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:25.419534 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:02:25.487539 tst mo_mt_call.py: using LAC 25534 03:02:25.616655 tst mo_mt_call.py: using RAC 34 03:02:25.738594 tst mo_mt_call.py: using CellId 25534 03:02:25.861518 tst mo_mt_call.py: using BVCI 25535 03:02:25.980846 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:25.993038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:26.004670 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:26.016449 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:26.028346 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:26.040232 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:26.156141 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:26.273589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:26.749466 run create_hlr_db(pid=17344): Launched 03:02:26.868922 bus /sierra_2: Setting Powered False 03:02:27.930303 run create_hlr_db(pid=17344): Terminated: ok {rc=0} 03:02:28.356349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17346): Launched 03:02:28.663051 run osmo-hlr_10.42.42.2(pid=17347): Launched 03:02:28.780668 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:29.321121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17349): Launched 03:02:29.626756 run osmo-stp_10.42.42.5(pid=17350): Launched 03:02:29.744483 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:30.298570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17352): Launched 03:02:30.603569 run osmo-msc_10.42.42.6(pid=17353): Launched 03:02:30.775629 run osmo-stp_10.42.42.5(pid=17350): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17350)] 03:02:31.013905 run osmo-stp_10.42.42.5(pid=17350): stdout: | (launched: 2022-12-10_03:02:29.570656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:31.171791 run osmo-stp_10.42.42.5(pid=17350): stderr: | [0;m[38;5;43m20221210030229744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030229744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030229745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030229745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:31.344362 run osmo-stp_10.42.42.5(pid=17350): stdout: | (launched: 2022-12-10_03:02:29.570656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:31.493993 run osmo-stp_10.42.42.5(pid=17350): stderr: | [0;m[38;5;43m20221210030229744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030229744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030229745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030229745 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030229746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:31.654965 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17350): Process ended prematurely: osmo-stp_10.42.42.5(pid=17350) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17350)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:02:31.665740 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:02:31.695599 run osmo-hlr_10.42.42.2(pid=17347): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17347)] 03:02:31.747654 run osmo-hlr_10.42.42.2(pid=17347): stdout: | (launched: 2022-12-10_03:02:28.606794) 03:02:31.801354 run osmo-hlr_10.42.42.2(pid=17347): stderr: | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030228782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030228794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030228805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030228805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030228805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:31.876293 run osmo-msc_10.42.42.6(pid=17353): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17353)] 03:02:31.927829 run osmo-msc_10.42.42.6(pid=17353): stdout: | (launched: 2022-12-10_03:02:30.547174) 03:02:31.981186 run osmo-msc_10.42.42.6(pid=17353): stderr: | [0;m[38;5;43m20221210030230817 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030230818 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb369dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030230818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030230818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030230818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030230818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030230820 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030230820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030230820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030230820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:32.034432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17346): Terminating (SIGTERM) 03:02:32.078538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17349): Terminating (SIGTERM) 03:02:32.124134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17352): Terminating (SIGTERM) 03:02:32.169877 --- ParallelTerminationStrategy: PID 17346 died... 03:02:32.190159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17346): Terminated: ok {rc=0} 03:02:32.239366 --- ParallelTerminationStrategy: PID 17349 died... 03:02:32.260822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17349): Terminated: ok {rc=0} 03:02:32.308684 --- ParallelTerminationStrategy: PID 17352 died... 03:02:32.328876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17352): Terminated: ok {rc=0} 03:02:32.418223 bus /sierra_3: Setting Powered False 03:02:33.517175 bus /sierra_3: Setting Powered False 03:02:34.634124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:02:35.785318 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:35.797926 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:02:35.866545 tst mo_mt_call_osmux.py: using LAC 25535 03:02:35.998529 tst mo_mt_call_osmux.py: using RAC 35 03:02:36.127814 tst mo_mt_call_osmux.py: using CellId 25535 03:02:36.256366 tst mo_mt_call_osmux.py: using BVCI 25536 03:02:36.374805 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:36.386639 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:36.398365 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:36.410025 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:36.421757 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:36.433333 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:36.549956 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:36.670805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:37.179568 run create_hlr_db(pid=17356): Launched 03:02:37.311942 bus /sierra_2: Setting Powered False 03:02:38.376191 run create_hlr_db(pid=17356): Terminated: ok {rc=0} 03:02:38.830948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Launched 03:02:39.158445 run osmo-hlr_10.42.42.2(pid=17359): Launched 03:02:39.283604 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:39.851733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Launched 03:02:40.179923 run osmo-stp_10.42.42.5(pid=17362): Launched 03:02:40.305074 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:40.898112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Launched 03:02:41.226130 run osmo-msc_10.42.42.6(pid=17365): Launched 03:02:41.408726 run osmo-stp_10.42.42.5(pid=17362): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] 03:02:41.546654 run osmo-stp_10.42.42.5(pid=17362): stdout: | (launched: 2022-12-10_03:02:40.119679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:41.685794 run osmo-stp_10.42.42.5(pid=17362): stderr: | [0;m[38;5;43m20221210030240314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030240314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030240315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030240315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030240315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030240315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030240316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:41.823812 run osmo-stp_10.42.42.5(pid=17362): stdout: | (launched: 2022-12-10_03:02:40.119679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:41.954340 run osmo-stp_10.42.42.5(pid=17362): stderr: | [0;m[38;5;43m20221210030240314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030240314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030240315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030240315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030240315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030240315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030240316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:42.110097 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17362): Process ended prematurely: osmo-stp_10.42.42.5(pid=17362) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:02:42.119788 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:02:42.148156 run osmo-hlr_10.42.42.2(pid=17359): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17359)] 03:02:42.198660 run osmo-hlr_10.42.42.2(pid=17359): stdout: | (launched: 2022-12-10_03:02:39.098511) 03:02:42.251056 run osmo-hlr_10.42.42.2(pid=17359): stderr: | [0;m[1;31m20221210030239299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030239300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030239300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030239300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030239300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030239300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030239312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030239320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030239320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030239320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:42.324097 run osmo-msc_10.42.42.6(pid=17365): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17365)] 03:02:42.374695 run osmo-msc_10.42.42.6(pid=17365): stdout: | (launched: 2022-12-10_03:02:41.165940) 03:02:42.427033 run osmo-msc_10.42.42.6(pid=17365): stderr: | [0;m[38;5;43m20221210030241490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030241491 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feccbac5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030241491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030241491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030241491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030241491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030241493 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030241493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030241493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030241493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:42.479634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Terminating (SIGTERM) 03:02:42.521727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Terminating (SIGTERM) 03:02:42.563863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Terminating (SIGTERM) 03:02:42.606475 --- ParallelTerminationStrategy: PID 17358 died... 03:02:42.626827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17358): Terminated: ok {rc=0} 03:02:42.674152 --- ParallelTerminationStrategy: PID 17361 died... 03:02:42.694114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17361): Terminated: ok {rc=0} 03:02:42.740418 --- ParallelTerminationStrategy: PID 17364 died... 03:02:42.760081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17364): Terminated: ok {rc=0} 03:02:42.849452 bus /sierra_3: Setting Powered False 03:02:43.949017 bus /sierra_3: Setting Powered False 03:02:45.064924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:02:46.369705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:46.377567 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:02:46.415714 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:02:46.450204 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:02:46.514123 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:02:46.549241 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:02:46.578011 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:02:47.160209 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:02:47.220179 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.232829 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:02:47.304502 tst mo_mt_call.py: using LAC 25536 03:02:47.432506 tst mo_mt_call.py: using RAC 36 03:02:47.560430 tst mo_mt_call.py: using CellId 25536 03:02:47.688828 tst mo_mt_call.py: using BVCI 25537 03:02:47.807719 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.819640 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.831174 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.842701 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.854157 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:47.865548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:47.981872 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:48.102202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:48.611536 run create_hlr_db(pid=17370): Launched 03:02:48.745103 bus /sierra_2: Setting Powered False 03:02:49.810226 run create_hlr_db(pid=17370): Terminated: ok {rc=0} 03:02:50.249254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Launched 03:02:50.555551 run osmo-hlr_10.42.42.2(pid=17373): Launched 03:02:50.673754 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:51.213403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Launched 03:02:51.520154 run osmo-stp_10.42.42.5(pid=17376): Launched 03:02:51.638355 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:52.193488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Launched 03:02:52.502084 run osmo-msc_10.42.42.6(pid=17379): Launched 03:02:52.674725 run osmo-stp_10.42.42.5(pid=17376): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] 03:02:52.804363 run osmo-stp_10.42.42.5(pid=17376): stdout: | (launched: 2022-12-10_03:02:51.463760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:52.934097 run osmo-stp_10.42.42.5(pid=17376): stderr: | [0;m[38;5;43m20221210030251636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030251636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030251637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030251637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030251637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030251637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030251638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:53.061944 run osmo-stp_10.42.42.5(pid=17376): stdout: | (launched: 2022-12-10_03:02:51.463760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:53.183545 run osmo-stp_10.42.42.5(pid=17376): stderr: | [0;m[38;5;43m20221210030251636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030251636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030251637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030251637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030251637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030251637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030251638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:53.328569 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17376): Process ended prematurely: osmo-stp_10.42.42.5(pid=17376) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:02:53.337399 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:02:53.364362 run osmo-hlr_10.42.42.2(pid=17373): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17373)] 03:02:53.412525 run osmo-hlr_10.42.42.2(pid=17373): stdout: | (launched: 2022-12-10_03:02:50.499192) 03:02:53.462432 run osmo-hlr_10.42.42.2(pid=17373): stderr: | [0;m[1;31m20221210030250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030250677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030250678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030250678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030250689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030250698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030250698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030250699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:53.531951 run osmo-msc_10.42.42.6(pid=17379): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17379)] 03:02:53.580132 run osmo-msc_10.42.42.6(pid=17379): stdout: | (launched: 2022-12-10_03:02:52.444935) 03:02:53.629829 run osmo-msc_10.42.42.6(pid=17379): stderr: | [0;m[38;5;43m20221210030252717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030252717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41a5921c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030252717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030252717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030252717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030252717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030252719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030252719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030252719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030252720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:53.680114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Terminating (SIGTERM) 03:02:53.720233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Terminating (SIGTERM) 03:02:53.759983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Terminating (SIGTERM) 03:02:53.800839 --- ParallelTerminationStrategy: PID 17372 died... 03:02:53.820049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17372): Terminated: ok {rc=0} 03:02:53.865206 --- ParallelTerminationStrategy: PID 17375 died... 03:02:53.884524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17375): Terminated: ok {rc=0} 03:02:53.929381 --- ParallelTerminationStrategy: PID 17378 died... 03:02:53.948205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17378): Terminated: ok {rc=0} 03:02:54.035159 bus /sierra_3: Setting Powered False 03:02:55.136751 bus /sierra_3: Setting Powered False 03:02:56.253903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:02:57.404636 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:57.416895 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:02:57.486093 tst mo_mt_call_osmux.py: using LAC 25537 03:02:57.615178 tst mo_mt_call_osmux.py: using RAC 37 03:02:57.743893 tst mo_mt_call_osmux.py: using CellId 25537 03:02:57.871780 tst mo_mt_call_osmux.py: using BVCI 25538 03:02:57.991320 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:58.003019 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:58.014474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:58.025936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:58.037496 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:58.048775 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:58.167123 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:58.288251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:58.796937 run create_hlr_db(pid=17382): Launched 03:02:58.930724 bus /sierra_2: Setting Powered False 03:02:59.994967 run create_hlr_db(pid=17382): Terminated: ok {rc=0} 03:03:00.432099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17384): Launched 03:03:00.740391 run osmo-hlr_10.42.42.2(pid=17385): Launched 03:03:00.891183 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:01.517083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Launched 03:03:01.841456 run osmo-stp_10.42.42.5(pid=17389): Launched 03:03:02.053520 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:02.730583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17391): Launched 03:03:03.041766 run osmo-msc_10.42.42.6(pid=17392): Launched 03:03:03.228486 run osmo-stp_10.42.42.5(pid=17389): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] 03:03:03.369213 run osmo-stp_10.42.42.5(pid=17389): stdout: | (launched: 2022-12-10_03:03:01.781886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:03.511625 run osmo-stp_10.42.42.5(pid=17389): stderr: | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030302112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:03.650907 run osmo-stp_10.42.42.5(pid=17389): stdout: | (launched: 2022-12-10_03:03:01.781886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:03.782547 run osmo-stp_10.42.42.5(pid=17389): stderr: | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030302112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030302112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030302125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:03.938312 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17389): Process ended prematurely: osmo-stp_10.42.42.5(pid=17389) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:03:03.948060 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:03:03.976510 run osmo-hlr_10.42.42.2(pid=17385): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17385)] 03:03:04.026770 run osmo-hlr_10.42.42.2(pid=17385): stdout: | (launched: 2022-12-10_03:03:00.683896) 03:03:04.078786 run osmo-hlr_10.42.42.2(pid=17385): stderr: | [0;m[1;31m20221210030300864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030300865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030300865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030300865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030300865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030300865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030300882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030300899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030300899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030300899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:04.151841 run osmo-msc_10.42.42.6(pid=17392): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17392)] 03:03:04.201944 run osmo-msc_10.42.42.6(pid=17392): stdout: | (launched: 2022-12-10_03:03:02.981371) 03:03:04.253808 run osmo-msc_10.42.42.6(pid=17392): stderr: | [0;m[38;5;43m20221210030303305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030303306 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14130b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030303306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030303308 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:04.305954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17384): Terminating (SIGTERM) 03:03:04.347829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Terminating (SIGTERM) 03:03:04.389650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17391): Terminating (SIGTERM) 03:03:04.432027 --- ParallelTerminationStrategy: PID 17384 died... 03:03:04.452229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17384): Terminated: ok {rc=0} 03:03:04.499145 --- ParallelTerminationStrategy: PID 17388 died... 03:03:04.518851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Terminated: ok {rc=0} 03:03:04.565257 --- ParallelTerminationStrategy: PID 17391 died... 03:03:04.584873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17391): Terminated: ok {rc=0} 03:03:04.671722 bus /sierra_3: Setting Powered False 03:03:05.771038 bus /sierra_3: Setting Powered False 03:03:06.889332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 03:03:08.132925 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:08.138486 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:03:08.168242 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:03:08.195820 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:03:08.282678 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:03:08.312448 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:03:08.340062 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:03:08.927138 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 03:03:08.932518 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:08.943974 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:08.990407 tst emergency_mo_mt_call.py: using LAC 25538 03:03:09.117938 tst emergency_mo_mt_call.py: using RAC 38 03:03:09.246710 tst emergency_mo_mt_call.py: using CellId 25538 03:03:09.371224 tst emergency_mo_mt_call.py: using BVCI 25539 03:03:09.486797 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:09.498691 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:09.509926 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:09.520933 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:09.532250 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:09.543523 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:09.663734 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:09.778427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:10.245063 run create_hlr_db(pid=17397): Launched 03:03:10.361644 bus /sierra_2: Setting Powered False 03:03:11.422189 run create_hlr_db(pid=17397): Terminated: ok {rc=0} 03:03:11.863405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Launched 03:03:12.185874 run osmo-hlr_10.42.42.2(pid=17400): Launched 03:03:12.308612 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:12.868259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Launched 03:03:13.188823 run osmo-stp_10.42.42.5(pid=17403): Launched 03:03:13.321398 tst emergency_mo_mt_call.py: using MSISDN 7514 03:03:13.485645 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:14.067605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17405): Launched 03:03:14.389724 run osmo-msc_10.42.42.6(pid=17406): Launched 03:03:14.569492 run osmo-stp_10.42.42.5(pid=17403): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] 03:03:14.705431 run osmo-stp_10.42.42.5(pid=17403): stdout: | (launched: 2022-12-10_03:03:13.130245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:14.841957 run osmo-stp_10.42.42.5(pid=17403): stderr: | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030313322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:14.977196 run osmo-stp_10.42.42.5(pid=17403): stdout: | (launched: 2022-12-10_03:03:13.130245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:15.104877 run osmo-stp_10.42.42.5(pid=17403): stderr: | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030313321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030313322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030313322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:15.258091 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17403): Process ended prematurely: osmo-stp_10.42.42.5(pid=17403) [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 03:03:15.266812 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 03:03:15.294565 run osmo-hlr_10.42.42.2(pid=17400): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17400)] 03:03:15.344813 run osmo-hlr_10.42.42.2(pid=17400): stdout: | (launched: 2022-12-10_03:03:12.127143) 03:03:15.396492 run osmo-hlr_10.42.42.2(pid=17400): stderr: | [0;m[1;31m20221210030312324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030312324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030312325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030312325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030312325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030312325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030312337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030312345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030312346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030312346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:15.468620 run osmo-msc_10.42.42.6(pid=17406): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17406)] 03:03:15.518595 run osmo-msc_10.42.42.6(pid=17406): stdout: | (launched: 2022-12-10_03:03:14.330565) 03:03:15.570168 run osmo-msc_10.42.42.6(pid=17406): stderr: | [0;m[38;5;43m20221210030314652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030314652 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2a381cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030314653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030314653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030314653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030314653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030314655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030314655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030314655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030314655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:15.622108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Terminating (SIGTERM) 03:03:15.663517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Terminating (SIGTERM) 03:03:15.705476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17405): Terminating (SIGTERM) 03:03:15.748074 --- ParallelTerminationStrategy: PID 17399 died... 03:03:15.768202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Terminated: ok {rc=0} 03:03:15.814513 --- ParallelTerminationStrategy: PID 17402 died... 03:03:15.843503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Terminated: ok {rc=0} 03:03:15.895101 --- ParallelTerminationStrategy: PID 17405 died... 03:03:15.915441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17405): Terminated: ok {rc=0} 03:03:16.006882 bus /sierra_3: Setting Powered False 03:03:17.117587 bus /sierra_3: Setting Powered False 03:03:18.259118 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 03:03:19.346369 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.358459 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:19.406786 tst emergency_preemptive_call.py: using LAC 25539 03:03:19.535017 tst emergency_preemptive_call.py: using RAC 39 03:03:19.661358 tst emergency_preemptive_call.py: using CellId 25539 03:03:19.787409 tst emergency_preemptive_call.py: using BVCI 25540 03:03:19.899566 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.910687 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.921497 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.932601 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.943894 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:19.955097 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:20.069535 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:20.189547 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:20.310246 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:20.426431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:20.893736 run create_hlr_db(pid=17408): Launched 03:03:21.008938 bus /sierra_2: Setting Powered False 03:03:22.069695 run create_hlr_db(pid=17408): Terminated: ok {rc=0} 03:03:22.511193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Launched 03:03:22.833489 run osmo-hlr_10.42.42.2(pid=17411): Launched 03:03:22.957143 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:23.515602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Launched 03:03:23.837473 run osmo-stp_10.42.42.5(pid=17414): Launched 03:03:23.974018 tst emergency_preemptive_call.py: using MSISDN 7515 03:03:24.139594 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:24.715912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Launched 03:03:25.036482 run osmo-msc_10.42.42.6(pid=17417): Launched 03:03:25.215829 run osmo-stp_10.42.42.5(pid=17414): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] 03:03:25.351389 run osmo-stp_10.42.42.5(pid=17414): stdout: | (launched: 2022-12-10_03:03:23.778777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:25.487749 run osmo-stp_10.42.42.5(pid=17414): stderr: | [0;m[38;5;43m20221210030323972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030323972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030323973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030323973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030323973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030323973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030323974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:25.623413 run osmo-stp_10.42.42.5(pid=17414): stdout: | (launched: 2022-12-10_03:03:23.778777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:25.751543 run osmo-stp_10.42.42.5(pid=17414): stderr: | [0;m[38;5;43m20221210030323972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030323972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030323973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030323973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030323973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030323973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030323974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:25.904178 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17414): Process ended prematurely: osmo-stp_10.42.42.5(pid=17414) [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 03:03:25.912922 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 03:03:25.940803 run osmo-hlr_10.42.42.2(pid=17411): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17411)] 03:03:25.990835 run osmo-hlr_10.42.42.2(pid=17411): stdout: | (launched: 2022-12-10_03:03:22.774955) 03:03:26.043105 run osmo-hlr_10.42.42.2(pid=17411): stderr: | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030322974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030322987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030322995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030322995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030322995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:26.115602 run osmo-msc_10.42.42.6(pid=17417): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17417)] 03:03:26.166251 run osmo-msc_10.42.42.6(pid=17417): stdout: | (launched: 2022-12-10_03:03:24.977721) 03:03:26.217866 run osmo-msc_10.42.42.6(pid=17417): stderr: | [0;m[38;5;43m20221210030325299 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030325300 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3cda58dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030325300 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030325300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030325300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030325300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030325302 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030325302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030325302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030325302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:26.271439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Terminating (SIGTERM) 03:03:26.312793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Terminating (SIGTERM) 03:03:26.354507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Terminating (SIGTERM) 03:03:26.396721 --- ParallelTerminationStrategy: PID 17410 died... 03:03:26.417018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17410): Terminated: ok {rc=0} 03:03:26.463317 --- ParallelTerminationStrategy: PID 17413 died... 03:03:26.483100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17413): Terminated: ok {rc=0} 03:03:26.529159 --- ParallelTerminationStrategy: PID 17416 died... 03:03:26.548690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17416): Terminated: ok {rc=0} 03:03:26.637349 bus /sierra_9: Setting Powered False 03:03:27.737333 bus /sierra_9: Setting Powered False 03:03:28.855657 bus /sierra_8: Setting Powered False 03:03:29.953216 bus /sierra_8: Setting Powered False 03:03:31.069688 bus /sierra_3: Setting Powered False 03:03:32.174474 bus /sierra_3: Setting Powered False 03:03:33.294984 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 03:03:34.574305 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:34.579283 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:03:34.608735 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 03:03:34.647105 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:03:34.733922 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:03:34.762969 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 03:03:34.801127 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:03:35.392331 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 03:03:35.447871 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:35.459357 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:35.505580 tst cs_paging_gprs_active.py: using LAC 25540 03:03:35.635868 tst cs_paging_gprs_active.py: using RAC 40 03:03:35.765429 tst cs_paging_gprs_active.py: using CellId 25540 03:03:35.886446 tst cs_paging_gprs_active.py: using BVCI 25541 03:03:35.998690 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.009541 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.020145 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.031529 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.042800 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.053945 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.065355 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.076490 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:36.087991 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:36.210346 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:36.332123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:03:36.555169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:36.886326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Launched 03:03:37.172784 run iperf3-srv_10.42.42.10(pid=17424): Launched 03:03:37.297147 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:03:37.517822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:37.847251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Launched 03:03:38.132837 run iperf3-srv_10.42.42.10(pid=17426): Launched 03:03:38.257858 tst cs_paging_gprs_active.py:38: start network... 03:03:38.478852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:38.987960 run create_hlr_db(pid=17427): Launched 03:03:39.123041 bus /sierra_2: Setting Powered False 03:03:40.187902 run create_hlr_db(pid=17427): Terminated: ok {rc=0} 03:03:40.626755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Launched 03:03:40.934905 run osmo-hlr_10.42.42.2(pid=17430): Launched 03:03:41.053554 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:41.584057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Launched 03:03:41.892792 run osmo-stp_10.42.42.5(pid=17433): Launched 03:03:42.011876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:03:42.541900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Launched 03:03:42.660099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:03:42.919741 run patchelf(pid=17436): Launched 03:03:43.091325 run osmo-stp_10.42.42.5(pid=17433): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] 03:03:43.221341 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-10_03:03:41.836001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:43.353199 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030342007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:43.485151 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-10_03:03:41.836001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:43.611298 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030342006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030342007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030342007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:43.760852 run patchelf(pid=17436): Terminating (SIGINT) 03:03:43.933369 run patchelf(pid=17436): Terminated: ok {rc=0} 03:03:44.057407 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2368↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] [trial-2368↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 03:03:44.066794 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:03:44.095072 run osmo-hlr_10.42.42.2(pid=17430): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17430)] 03:03:44.143358 run osmo-hlr_10.42.42.2(pid=17430): stdout: | (launched: 2022-12-10_03:03:40.878268) 03:03:44.193355 run osmo-hlr_10.42.42.2(pid=17430): stderr: | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030341057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030341070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030341079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030341079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030341079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:44.243750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Terminating (SIGTERM) 03:03:44.284500 run iperf3-srv_10.42.42.10(pid=17424): Terminating (SIGTERM) 03:03:44.324864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Terminating (SIGTERM) 03:03:44.365282 run iperf3-srv_10.42.42.10(pid=17426): Terminating (SIGTERM) 03:03:44.405644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminating (SIGTERM) 03:03:44.446032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminating (SIGTERM) 03:03:44.486231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Terminating (SIGTERM) 03:03:44.526971 --- ParallelTerminationStrategy: PID 17423 died... 03:03:44.546406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Terminated: ok {rc=0} 03:03:44.591569 --- ParallelTerminationStrategy: PID 17424 died... 03:03:44.610627 run iperf3-srv_10.42.42.10(pid=17424): Terminated {rc=256} 03:03:44.655645 --- ParallelTerminationStrategy: PID 17425 died... 03:03:44.674713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Terminated: ok {rc=0} 03:03:44.719514 --- ParallelTerminationStrategy: PID 17426 died... 03:03:44.738498 run iperf3-srv_10.42.42.10(pid=17426): Terminated {rc=256} 03:03:44.783579 --- ParallelTerminationStrategy: PID 17429 died... 03:03:44.802714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminated: ok {rc=0} 03:03:44.847819 --- ParallelTerminationStrategy: PID 17432 died... 03:03:44.866969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminated: ok {rc=0} 03:03:44.911801 --- ParallelTerminationStrategy: PID 17435 died... 03:03:44.930609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Terminated: ok {rc=0} 03:03:45.017410 bus /gobi_0: Setting Powered False 03:03:46.121148 bus /gobi_0: Setting Powered False 03:03:47.251558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 03:03:48.398943 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.410379 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:48.458444 tst iperf3.py: using LAC 25541 03:03:48.580094 tst iperf3.py: using RAC 41 03:03:48.702301 tst iperf3.py: using CellId 25541 03:03:48.822431 tst iperf3.py: using BVCI 25542 03:03:48.935817 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.946880 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.957751 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.968458 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.979280 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:48.990209 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:49.001280 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:49.012048 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:49.023081 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:49.140154 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:03:49.344591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:49.652550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17437): Launched 03:03:49.919977 run iperf3-srv_10.42.42.10(pid=17438): Launched 03:03:50.035316 tst iperf3.py:8: start network... 03:03:50.239731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:50.713127 run create_hlr_db(pid=17439): Launched 03:03:50.830863 bus /gobi_6: Setting Powered False 03:03:51.892002 run create_hlr_db(pid=17439): Terminated: ok {rc=0} 03:03:52.338705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17441): Launched 03:03:52.668015 run osmo-hlr_10.42.42.2(pid=17442): Launched 03:03:52.795029 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:53.363202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17444): Launched 03:03:53.691578 run osmo-stp_10.42.42.5(pid=17445): Launched 03:03:53.816837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:03:54.382666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17447): Launched 03:03:54.508452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:03:54.785938 run patchelf(pid=17448): Launched 03:03:54.968583 run osmo-stp_10.42.42.5(pid=17445): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17445)] 03:03:55.106667 run osmo-stp_10.42.42.5(pid=17445): stdout: | (launched: 2022-12-10_03:03:53.631422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:55.246696 run osmo-stp_10.42.42.5(pid=17445): stderr: | [0;m[38;5;43m20221210030353823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030353823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030353824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030353824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:55.386376 run osmo-stp_10.42.42.5(pid=17445): stdout: | (launched: 2022-12-10_03:03:53.631422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:55.520826 run osmo-stp_10.42.42.5(pid=17445): stderr: | [0;m[38;5;43m20221210030353823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030353823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030353824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030353824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030353825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:55.680039 run patchelf(pid=17448): Terminating (SIGINT) 03:03:55.864513 run patchelf(pid=17448): Terminated: ok {rc=0} 03:03:55.996463 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17445): Process ended prematurely: osmo-stp_10.42.42.5(pid=17445) [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17445)] [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 03:03:56.006462 tst iperf3.py:8: Test FAILED (7.6 sec) 03:03:56.035120 run osmo-hlr_10.42.42.2(pid=17442): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17442)] 03:03:56.085929 run osmo-hlr_10.42.42.2(pid=17442): stdout: | (launched: 2022-12-10_03:03:52.607876) 03:03:56.138103 run osmo-hlr_10.42.42.2(pid=17442): stderr: | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030352809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030352821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030352829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030352829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030352829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:56.191280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17437): Terminating (SIGTERM) 03:03:56.233764 run iperf3-srv_10.42.42.10(pid=17438): Terminating (SIGTERM) 03:03:56.275735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17441): Terminating (SIGTERM) 03:03:56.317830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17444): Terminating (SIGTERM) 03:03:56.359726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17447): Terminating (SIGTERM) 03:03:56.402694 --- ParallelTerminationStrategy: PID 17437 died... 03:03:56.422996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17437): Terminated: ok {rc=0} 03:03:56.469938 --- ParallelTerminationStrategy: PID 17438 died... 03:03:56.490039 run iperf3-srv_10.42.42.10(pid=17438): Terminated {rc=256} 03:03:56.536440 --- ParallelTerminationStrategy: PID 17441 died... 03:03:56.556345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17441): Terminated: ok {rc=0} 03:03:56.603089 --- ParallelTerminationStrategy: PID 17444 died... 03:03:56.622999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17444): Terminated: ok {rc=0} 03:03:56.669572 --- ParallelTerminationStrategy: PID 17447 died... 03:03:56.689485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17447): Terminated: ok {rc=0} 03:03:56.777740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 03:03:57.929653 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:57.941641 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:57.988313 tst iperf3m4.py: using LAC 25542 03:03:58.118793 tst iperf3m4.py: using RAC 42 03:03:58.253258 tst iperf3m4.py: using CellId 25542 03:03:58.380608 tst iperf3m4.py: using BVCI 25543 03:03:58.493692 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.504531 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.515656 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.527235 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.538797 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.550183 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.561977 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.573555 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:58.585103 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:58.708401 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:58.829527 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:58.951339 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:59.071976 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:03:59.276842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:59.583690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17449): Launched 03:03:59.850504 run iperf3-srv_10.42.42.10(pid=17450): Launched 03:03:59.965814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:04:00.169917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:00.476744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17451): Launched 03:04:00.743566 run iperf3-srv_10.42.42.10(pid=17452): Launched 03:04:00.871504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:04:01.082773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:01.398171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17453): Launched 03:04:01.684821 run iperf3-srv_10.42.42.10(pid=17454): Launched 03:04:01.818050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:04:02.027967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:02.339830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17455): Launched 03:04:02.606550 run iperf3-srv_10.42.42.10(pid=17456): Launched 03:04:02.722002 tst iperf3m4.py:8: start network... 03:04:02.925978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:03.398710 run create_hlr_db(pid=17457): Launched 03:04:03.515283 bus /gobi_6: Setting Powered False 03:04:04.575789 run create_hlr_db(pid=17457): Terminated: ok {rc=0} 03:04:05.021679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17459): Launched 03:04:05.350876 run osmo-hlr_10.42.42.2(pid=17460): Launched 03:04:05.477080 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:06.148375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17462): Launched 03:04:06.467569 run osmo-stp_10.42.42.5(pid=17463): Launched 03:04:06.589627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:07.140732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17465): Launched 03:04:07.263475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:07.532923 run patchelf(pid=17466): Launched 03:04:07.711250 run osmo-stp_10.42.42.5(pid=17463): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17463)] 03:04:07.846157 run osmo-stp_10.42.42.5(pid=17463): stdout: | (launched: 2022-12-10_03:04:06.408807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:07.982238 run osmo-stp_10.42.42.5(pid=17463): stderr: | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030406600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:08.118615 run osmo-stp_10.42.42.5(pid=17463): stdout: | (launched: 2022-12-10_03:04:06.408807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:08.249541 run osmo-stp_10.42.42.5(pid=17463): stderr: | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030406600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030406600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030406601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:08.404888 run patchelf(pid=17466): Terminating (SIGINT) 03:04:08.584684 run patchelf(pid=17466): Terminated: ok {rc=0} 03:04:08.714351 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17463): Process ended prematurely: osmo-stp_10.42.42.5(pid=17463) [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17463)] [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 03:04:08.724365 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:04:08.753261 run osmo-hlr_10.42.42.2(pid=17460): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17460)] 03:04:08.803028 run osmo-hlr_10.42.42.2(pid=17460): stdout: | (launched: 2022-12-10_03:04:05.290566) 03:04:08.854691 run osmo-hlr_10.42.42.2(pid=17460): stderr: | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030405489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030405501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030405510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030405510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030405511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:08.906591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17449): Terminating (SIGTERM) 03:04:08.948343 run iperf3-srv_10.42.42.10(pid=17450): Terminating (SIGTERM) 03:04:08.990156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17451): Terminating (SIGTERM) 03:04:09.031838 run iperf3-srv_10.42.42.10(pid=17452): Terminating (SIGTERM) 03:04:09.073434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17453): Terminating (SIGTERM) 03:04:09.115349 run iperf3-srv_10.42.42.10(pid=17454): Terminating (SIGTERM) 03:04:09.156927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17455): Terminating (SIGTERM) 03:04:09.198591 run iperf3-srv_10.42.42.10(pid=17456): Terminating (SIGTERM) 03:04:09.240198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17459): Terminating (SIGTERM) 03:04:09.281928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17462): Terminating (SIGTERM) 03:04:09.323520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17465): Terminating (SIGTERM) 03:04:09.365560 --- ParallelTerminationStrategy: PID 17449 died... 03:04:09.385559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17449): Terminated: ok {rc=0} 03:04:09.431827 --- ParallelTerminationStrategy: PID 17450 died... 03:04:09.451591 run iperf3-srv_10.42.42.10(pid=17450): Terminated {rc=256} 03:04:09.497429 --- ParallelTerminationStrategy: PID 17451 died... 03:04:09.517084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17451): Terminated: ok {rc=0} 03:04:09.562986 --- ParallelTerminationStrategy: PID 17452 died... 03:04:09.582665 run iperf3-srv_10.42.42.10(pid=17452): Terminated {rc=256} 03:04:09.628459 --- ParallelTerminationStrategy: PID 17453 died... 03:04:09.648063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17453): Terminated: ok {rc=0} 03:04:09.694038 --- ParallelTerminationStrategy: PID 17454 died... 03:04:09.714004 run iperf3-srv_10.42.42.10(pid=17454): Terminated {rc=256} 03:04:09.759912 --- ParallelTerminationStrategy: PID 17455 died... 03:04:09.779557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17455): Terminated: ok {rc=0} 03:04:09.825240 --- ParallelTerminationStrategy: PID 17456 died... 03:04:09.844873 run iperf3-srv_10.42.42.10(pid=17456): Terminated {rc=256} 03:04:09.890698 --- ParallelTerminationStrategy: PID 17459 died... 03:04:09.910402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17459): Terminated: ok {rc=0} 03:04:09.956073 --- ParallelTerminationStrategy: PID 17462 died... 03:04:09.975615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17462): Terminated: ok {rc=0} 03:04:10.021163 --- ParallelTerminationStrategy: PID 17465 died... 03:04:10.040658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17465): Terminated: ok {rc=0} 03:04:10.127706 bus /gobi_4: Setting Powered False 03:04:11.227496 bus /gobi_4: Setting Powered False 03:04:12.344806 bus /gobi_1: Setting Powered False 03:04:13.442162 bus /gobi_1: Setting Powered False 03:04:14.558087 bus /gobi_0: Setting Powered False 03:04:15.655469 bus /gobi_0: Setting Powered False 03:04:16.784931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 03:04:17.900221 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:17.911729 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:17.957788 tst ping.py: using LAC 25543 03:04:18.074716 tst ping.py: using RAC 43 03:04:18.192517 tst ping.py: using CellId 25543 03:04:18.308904 tst ping.py: using BVCI 25544 03:04:18.417292 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.427883 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.438488 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.449396 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.459971 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.470718 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.481630 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:18.492471 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:18.611381 tst ping.py:19: start network... 03:04:18.808332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:19.262786 run create_hlr_db(pid=17467): Launched 03:04:19.374828 bus /gobi_6: Setting Powered False 03:04:20.434038 run create_hlr_db(pid=17467): Terminated: ok {rc=0} 03:04:20.846305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17469): Launched 03:04:21.141534 run osmo-hlr_10.42.42.2(pid=17470): Launched 03:04:21.254941 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:21.772819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17472): Launched 03:04:22.069945 run osmo-stp_10.42.42.5(pid=17473): Launched 03:04:22.183222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:22.705760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17475): Launched 03:04:22.819639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:23.069294 run patchelf(pid=17476): Launched 03:04:23.234804 run osmo-stp_10.42.42.5(pid=17473): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17473)] 03:04:23.360542 run osmo-stp_10.42.42.5(pid=17473): stdout: | (launched: 2022-12-10_03:04:22.015366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:23.488020 run osmo-stp_10.42.42.5(pid=17473): stderr: | [0;m[38;5;43m20221210030422182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030422183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030422183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030422183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:23.615683 run osmo-stp_10.42.42.5(pid=17473): stdout: | (launched: 2022-12-10_03:04:22.015366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:23.737554 run osmo-stp_10.42.42.5(pid=17473): stderr: | [0;m[38;5;43m20221210030422182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030422183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030422183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030422183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030422184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:23.881616 run patchelf(pid=17476): Terminating (SIGINT) 03:04:24.048448 run patchelf(pid=17476): Terminated: ok {rc=0} 03:04:24.168831 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17473): Process ended prematurely: osmo-stp_10.42.42.5(pid=17473) [trial-2368↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17473)] [trial-2368↪gprs:trx-lms-limenet-micro↪ping.py:22] 03:04:24.178000 tst ping.py:22: Test FAILED (6.3 sec) 03:04:24.205614 run osmo-hlr_10.42.42.2(pid=17470): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17470)] 03:04:24.254055 run osmo-hlr_10.42.42.2(pid=17470): stdout: | (launched: 2022-12-10_03:04:21.087531) 03:04:24.304031 run osmo-hlr_10.42.42.2(pid=17470): stderr: | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030421264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030421276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030421284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030421285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030421285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:24.354409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17469): Terminating (SIGTERM) 03:04:24.394728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17472): Terminating (SIGTERM) 03:04:24.434966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17475): Terminating (SIGTERM) 03:04:24.475467 --- ParallelTerminationStrategy: PID 17469 died... 03:04:24.494711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17469): Terminated: ok {rc=0} 03:04:24.539236 --- ParallelTerminationStrategy: PID 17472 died... 03:04:24.557913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17472): Terminated: ok {rc=0} 03:04:24.602066 --- ParallelTerminationStrategy: PID 17475 died... 03:04:24.621255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17475): Terminated: ok {rc=0} 03:04:24.707583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 03:04:25.795801 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:25.807331 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:25.852585 tst ping_idle_ping.py: using LAC 25544 03:04:25.970702 tst ping_idle_ping.py: using RAC 44 03:04:26.086681 tst ping_idle_ping.py: using CellId 25544 03:04:26.205248 tst ping_idle_ping.py: using BVCI 25545 03:04:26.312304 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.323018 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.333672 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.344447 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.355198 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.365974 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.376806 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.387602 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:26.502821 tst ping_idle_ping.py:24: start network... 03:04:26.702251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:27.161435 run create_hlr_db(pid=17477): Launched 03:04:27.274743 bus /gobi_6: Setting Powered False 03:04:28.334828 run create_hlr_db(pid=17477): Terminated: ok {rc=0} 03:04:28.769926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17480): Launched 03:04:29.086398 run osmo-hlr_10.42.42.2(pid=17481): Launched 03:04:29.206620 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:29.754951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17483): Launched 03:04:30.071796 run osmo-stp_10.42.42.5(pid=17484): Launched 03:04:30.193013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:30.739120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17486): Launched 03:04:30.876836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:31.143294 run patchelf(pid=17487): Launched 03:04:31.353824 run osmo-stp_10.42.42.5(pid=17484): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17484)] 03:04:31.486571 run osmo-stp_10.42.42.5(pid=17484): stdout: | (launched: 2022-12-10_03:04:30.014087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:31.619735 run osmo-stp_10.42.42.5(pid=17484): stderr: | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030430207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:31.752888 run osmo-stp_10.42.42.5(pid=17484): stdout: | (launched: 2022-12-10_03:04:30.014087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:31.880383 run osmo-stp_10.42.42.5(pid=17484): stderr: | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030430207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030430207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030430208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:32.029586 run patchelf(pid=17487): Terminating (SIGINT) 03:04:32.205093 run patchelf(pid=17487): Terminated: ok {rc=0} 03:04:32.333961 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17484): Process ended prematurely: osmo-stp_10.42.42.5(pid=17484) [trial-2368↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17484)] [trial-2368↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 03:04:32.343349 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:04:32.371398 run osmo-hlr_10.42.42.2(pid=17481): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17481)] 03:04:32.421566 run osmo-hlr_10.42.42.2(pid=17481): stdout: | (launched: 2022-12-10_03:04:29.029072) 03:04:32.473377 run osmo-hlr_10.42.42.2(pid=17481): stderr: | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030429224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030429236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030429245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030429245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030429245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:32.525812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17480): Terminating (SIGTERM) 03:04:32.567665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17483): Terminating (SIGTERM) 03:04:32.609421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17486): Terminating (SIGTERM) 03:04:32.651364 --- ParallelTerminationStrategy: PID 17480 died... 03:04:32.671560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17480): Terminated: ok {rc=0} 03:04:32.718068 --- ParallelTerminationStrategy: PID 17483 died... 03:04:32.737625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17483): Terminated: ok {rc=0} 03:04:32.783846 --- ParallelTerminationStrategy: PID 17486 died... 03:04:32.803150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17486): Terminated: ok {rc=0} 03:04:32.891387 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 03:04:34.194898 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:04:34.200641 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:04:34.230163 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:04:34.269514 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:04:34.357570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:04:34.387169 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:04:34.426351 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:04:35.024824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:04:35.076304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.087949 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:04:35.135504 tst cs_paging_gprs_active.py: using LAC 25545 03:04:35.255273 tst cs_paging_gprs_active.py: using RAC 45 03:04:35.376109 tst cs_paging_gprs_active.py: using CellId 25545 03:04:35.496408 tst cs_paging_gprs_active.py: using BVCI 25546 03:04:35.606638 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.617863 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.628791 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.640056 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.651361 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.662477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.674361 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.685664 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:35.697088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:35.812439 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:35.934051 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:04:36.151221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:36.474754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Launched 03:04:36.755533 run iperf3-srv_10.42.42.10(pid=17492): Launched 03:04:36.877412 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:04:37.093474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:37.416091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Launched 03:04:37.695328 run iperf3-srv_10.42.42.10(pid=17494): Launched 03:04:37.817616 tst cs_paging_gprs_active.py:38: start network... 03:04:38.035254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:38.534904 run create_hlr_db(pid=17495): Launched 03:04:38.666538 bus /gobi_6: Setting Powered False 03:04:39.730503 run create_hlr_db(pid=17495): Terminated: ok {rc=0} 03:04:40.178087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17497): Launched 03:04:40.501035 run osmo-hlr_10.42.42.2(pid=17498): Launched 03:04:40.625642 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:41.178535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17500): Launched 03:04:41.500509 run osmo-stp_10.42.42.5(pid=17501): Launched 03:04:41.624210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:42.181757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17503): Launched 03:04:42.305615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:42.578451 run patchelf(pid=17504): Launched 03:04:42.757917 run osmo-stp_10.42.42.5(pid=17501): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17501)] 03:04:42.893856 run osmo-stp_10.42.42.5(pid=17501): stdout: | (launched: 2022-12-10_03:04:41.441720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:43.031159 run osmo-stp_10.42.42.5(pid=17501): stderr: | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030441635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:43.168434 run osmo-stp_10.42.42.5(pid=17501): stdout: | (launched: 2022-12-10_03:04:41.441720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:43.300600 run osmo-stp_10.42.42.5(pid=17501): stderr: | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030441634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030441635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030441637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:43.456783 run patchelf(pid=17504): Terminating (SIGINT) 03:04:43.637213 run patchelf(pid=17504): Terminated: ok {rc=0} 03:04:43.768092 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17501): Process ended prematurely: osmo-stp_10.42.42.5(pid=17501) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17501)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:04:43.778078 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:04:43.806383 run osmo-hlr_10.42.42.2(pid=17498): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17498)] 03:04:43.855964 run osmo-hlr_10.42.42.2(pid=17498): stdout: | (launched: 2022-12-10_03:04:40.442190) 03:04:43.907364 run osmo-hlr_10.42.42.2(pid=17498): stderr: | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030440641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030440656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030440667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030440667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030440667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:43.959379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Terminating (SIGTERM) 03:04:44.000823 run iperf3-srv_10.42.42.10(pid=17492): Terminating (SIGTERM) 03:04:44.042232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Terminating (SIGTERM) 03:04:44.083882 run iperf3-srv_10.42.42.10(pid=17494): Terminating (SIGTERM) 03:04:44.125187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17497): Terminating (SIGTERM) 03:04:44.166545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17500): Terminating (SIGTERM) 03:04:44.207714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17503): Terminating (SIGTERM) 03:04:44.249199 --- ParallelTerminationStrategy: PID 17491 died... 03:04:44.269048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Terminated: ok {rc=0} 03:04:44.314858 --- ParallelTerminationStrategy: PID 17492 died... 03:04:44.334301 run iperf3-srv_10.42.42.10(pid=17492): Terminated {rc=256} 03:04:44.379673 --- ParallelTerminationStrategy: PID 17493 died... 03:04:44.399121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Terminated: ok {rc=0} 03:04:44.444392 --- ParallelTerminationStrategy: PID 17494 died... 03:04:44.463714 run iperf3-srv_10.42.42.10(pid=17494): Terminated {rc=256} 03:04:44.509097 --- ParallelTerminationStrategy: PID 17497 died... 03:04:44.528335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17497): Terminated: ok {rc=0} 03:04:44.574211 --- ParallelTerminationStrategy: PID 17500 died... 03:04:44.593624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17500): Terminated: ok {rc=0} 03:04:44.639176 --- ParallelTerminationStrategy: PID 17503 died... 03:04:44.658685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17503): Terminated: ok {rc=0} 03:04:44.745611 bus /gobi_0: Setting Powered False 03:04:45.865229 bus /gobi_0: Setting Powered False 03:04:46.999405 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:04:48.146641 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.158466 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:04:48.203568 tst iperf3.py: using LAC 25546 03:04:48.323360 tst iperf3.py: using RAC 46 03:04:48.440736 tst iperf3.py: using CellId 25546 03:04:48.558495 tst iperf3.py: using BVCI 25547 03:04:48.667808 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.679045 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.690185 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.701663 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.712853 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.724174 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.735728 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.747036 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:48.758723 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:48.880899 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:49.098165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:49.420273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17505): Launched 03:04:49.700351 run iperf3-srv_10.42.42.10(pid=17506): Launched 03:04:49.818631 tst iperf3.py:8: start network... 03:04:50.020149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:50.485181 run create_hlr_db(pid=17507): Launched 03:04:50.602744 bus /gobi_6: Setting Powered False 03:04:51.662911 run create_hlr_db(pid=17507): Terminated: ok {rc=0} 03:04:52.083147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17509): Launched 03:04:52.385492 run osmo-hlr_10.42.42.2(pid=17510): Launched 03:04:52.502368 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:53.021180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17512): Launched 03:04:53.321703 run osmo-stp_10.42.42.5(pid=17513): Launched 03:04:53.437367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:53.956025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17515): Launched 03:04:54.072442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:54.325670 run patchelf(pid=17516): Launched 03:04:54.494234 run osmo-stp_10.42.42.5(pid=17513): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17513)] 03:04:54.621885 run osmo-stp_10.42.42.5(pid=17513): stdout: | (launched: 2022-12-10_03:04:53.266464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:54.751003 run osmo-stp_10.42.42.5(pid=17513): stderr: | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030453435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:54.880192 run osmo-stp_10.42.42.5(pid=17513): stdout: | (launched: 2022-12-10_03:04:53.266464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:55.004062 run osmo-stp_10.42.42.5(pid=17513): stderr: | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030453435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030453435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030453438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:55.150802 run patchelf(pid=17516): Terminating (SIGINT) 03:04:55.320623 run patchelf(pid=17516): Terminated: ok {rc=0} 03:04:55.443441 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17513): Process ended prematurely: osmo-stp_10.42.42.5(pid=17513) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17513)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 03:04:55.452751 tst iperf3.py:8: Test FAILED (7.3 sec) 03:04:55.480457 run osmo-hlr_10.42.42.2(pid=17510): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17510)] 03:04:55.528409 run osmo-hlr_10.42.42.2(pid=17510): stdout: | (launched: 2022-12-10_03:04:52.329952) 03:04:55.578275 run osmo-hlr_10.42.42.2(pid=17510): stderr: | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030452508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030452524 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030452534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030452534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030452534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:55.628335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17505): Terminating (SIGTERM) 03:04:55.668409 run iperf3-srv_10.42.42.10(pid=17506): Terminating (SIGTERM) 03:04:55.708536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17509): Terminating (SIGTERM) 03:04:55.748572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17512): Terminating (SIGTERM) 03:04:55.788711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17515): Terminating (SIGTERM) 03:04:55.829146 --- ParallelTerminationStrategy: PID 17505 died... 03:04:55.848202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17505): Terminated: ok {rc=0} 03:04:55.893030 --- ParallelTerminationStrategy: PID 17506 died... 03:04:55.911707 run iperf3-srv_10.42.42.10(pid=17506): Terminated {rc=256} 03:04:55.955940 --- ParallelTerminationStrategy: PID 17509 died... 03:04:55.974740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17509): Terminated: ok {rc=0} 03:04:56.019060 --- ParallelTerminationStrategy: PID 17512 died... 03:04:56.037763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17512): Terminated: ok {rc=0} 03:04:56.082793 --- ParallelTerminationStrategy: PID 17515 died... 03:04:56.101665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17515): Terminated: ok {rc=0} 03:04:56.185896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:04:57.335803 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.348113 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:04:57.396707 tst iperf3m4.py: using LAC 25547 03:04:57.527154 tst iperf3m4.py: using RAC 47 03:04:57.653377 tst iperf3m4.py: using CellId 25547 03:04:57.778014 tst iperf3m4.py: using BVCI 25548 03:04:57.896050 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.907550 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.918815 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.930126 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.941430 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.952643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.964044 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.975206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:57.986688 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:58.111704 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:58.232360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:58.350088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:58.470663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:58.688189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:59.011882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17517): Launched 03:04:59.291734 run iperf3-srv_10.42.42.10(pid=17518): Launched 03:04:59.413694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:04:59.630158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:59.953204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17519): Launched 03:05:00.232770 run iperf3-srv_10.42.42.10(pid=17520): Launched 03:05:00.354219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:05:00.571106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:00.902386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17521): Launched 03:05:01.209715 run iperf3-srv_10.42.42.10(pid=17522): Launched 03:05:01.337664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:05:01.558174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:01.899844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17525): Launched 03:05:02.194435 run iperf3-srv_10.42.42.10(pid=17527): Launched 03:05:02.325149 tst iperf3m4.py:8: start network... 03:05:02.541495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:03.041349 run create_hlr_db(pid=17528): Launched 03:05:03.173233 bus /gobi_6: Setting Powered False 03:05:04.233164 run create_hlr_db(pid=17528): Terminated: ok {rc=0} 03:05:04.680840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17530): Launched 03:05:05.004512 run osmo-hlr_10.42.42.2(pid=17531): Launched 03:05:05.127507 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:05.682223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17533): Launched 03:05:06.005018 run osmo-stp_10.42.42.5(pid=17534): Launched 03:05:06.128232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:06.682912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17536): Launched 03:05:06.806646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:07.078772 run patchelf(pid=17537): Launched 03:05:07.258182 run osmo-stp_10.42.42.5(pid=17534): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17534)] 03:05:07.394537 run osmo-stp_10.42.42.5(pid=17534): stdout: | (launched: 2022-12-10_03:05:05.946109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:07.531874 run osmo-stp_10.42.42.5(pid=17534): stderr: | [0;m[38;5;43m20221210030506137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030506138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030506138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030506138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:07.669515 run osmo-stp_10.42.42.5(pid=17534): stdout: | (launched: 2022-12-10_03:05:05.946109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:07.801895 run osmo-stp_10.42.42.5(pid=17534): stderr: | [0;m[38;5;43m20221210030506137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030506138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030506138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030506138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030506139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:07.958189 run patchelf(pid=17537): Terminating (SIGINT) 03:05:08.138748 run patchelf(pid=17537): Terminated: ok {rc=0} 03:05:08.268560 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17534): Process ended prematurely: osmo-stp_10.42.42.5(pid=17534) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17534)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 03:05:08.278982 tst iperf3m4.py:8: Test FAILED (11.0 sec) 03:05:08.307675 run osmo-hlr_10.42.42.2(pid=17531): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17531)] 03:05:08.357950 run osmo-hlr_10.42.42.2(pid=17531): stdout: | (launched: 2022-12-10_03:05:04.945322) 03:05:08.410211 run osmo-hlr_10.42.42.2(pid=17531): stderr: | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030505142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030505158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030505167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030505168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030505168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:08.462637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17517): Terminating (SIGTERM) 03:05:08.504498 run iperf3-srv_10.42.42.10(pid=17518): Terminating (SIGTERM) 03:05:08.546537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17519): Terminating (SIGTERM) 03:05:08.588605 run iperf3-srv_10.42.42.10(pid=17520): Terminating (SIGTERM) 03:05:08.630649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17521): Terminating (SIGTERM) 03:05:08.674058 run iperf3-srv_10.42.42.10(pid=17522): Terminating (SIGTERM) 03:05:08.715975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17525): Terminating (SIGTERM) 03:05:08.758312 run iperf3-srv_10.42.42.10(pid=17527): Terminating (SIGTERM) 03:05:08.800332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17530): Terminating (SIGTERM) 03:05:08.842499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17533): Terminating (SIGTERM) 03:05:08.884513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17536): Terminating (SIGTERM) 03:05:08.926579 --- ParallelTerminationStrategy: PID 17517 died... 03:05:08.946725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17517): Terminated: ok {rc=0} 03:05:08.993555 --- ParallelTerminationStrategy: PID 17518 died... 03:05:09.013247 run iperf3-srv_10.42.42.10(pid=17518): Terminated {rc=256} 03:05:09.059524 --- ParallelTerminationStrategy: PID 17519 died... 03:05:09.079184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17519): Terminated: ok {rc=0} 03:05:09.125623 --- ParallelTerminationStrategy: PID 17520 died... 03:05:09.145223 run iperf3-srv_10.42.42.10(pid=17520): Terminated {rc=256} 03:05:09.191617 --- ParallelTerminationStrategy: PID 17521 died... 03:05:09.211187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17521): Terminated: ok {rc=0} 03:05:09.257612 --- ParallelTerminationStrategy: PID 17522 died... 03:05:09.277224 run iperf3-srv_10.42.42.10(pid=17522): Terminated {rc=256} 03:05:09.323832 --- ParallelTerminationStrategy: PID 17525 died... 03:05:09.343587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17525): Terminated: ok {rc=0} 03:05:09.390111 --- ParallelTerminationStrategy: PID 17527 died... 03:05:09.409812 run iperf3-srv_10.42.42.10(pid=17527): Terminated {rc=256} 03:05:09.456066 --- ParallelTerminationStrategy: PID 17530 died... 03:05:09.475941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17530): Terminated: ok {rc=0} 03:05:09.522497 --- ParallelTerminationStrategy: PID 17533 died... 03:05:09.542273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17533): Terminated: ok {rc=0} 03:05:09.588561 --- ParallelTerminationStrategy: PID 17536 died... 03:05:09.608325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17536): Terminated: ok {rc=0} 03:05:09.696224 bus /gobi_4: Setting Powered False 03:05:10.796923 bus /gobi_4: Setting Powered False 03:05:11.912127 bus /gobi_1: Setting Powered False 03:05:13.011300 bus /gobi_1: Setting Powered False 03:05:14.127227 bus /gobi_0: Setting Powered False 03:05:15.225373 bus /gobi_0: Setting Powered False 03:05:16.346587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 03:05:17.453076 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:17.464549 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:17.511945 tst ping.py: using LAC 25548 03:05:17.629802 tst ping.py: using RAC 48 03:05:17.745948 tst ping.py: using CellId 25548 03:05:17.860747 tst ping.py: using BVCI 25549 03:05:17.967106 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:17.978117 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:17.988866 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:17.999917 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:18.010814 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:18.021750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:18.032795 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:18.043800 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:18.160147 tst ping.py:19: start network... 03:05:18.371048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:18.853732 run create_hlr_db(pid=17538): Launched 03:05:18.981813 bus /gobi_6: Setting Powered False 03:05:20.043522 run create_hlr_db(pid=17538): Terminated: ok {rc=0} 03:05:20.460721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Launched 03:05:20.752216 run osmo-hlr_10.42.42.2(pid=17541): Launched 03:05:20.863790 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:21.368380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Launched 03:05:21.660045 run osmo-stp_10.42.42.5(pid=17544): Launched 03:05:21.772248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:22.276255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17546): Launched 03:05:22.389139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:22.635509 run patchelf(pid=17547): Launched 03:05:22.798993 run osmo-stp_10.42.42.5(pid=17544): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] 03:05:22.923425 run osmo-stp_10.42.42.5(pid=17544): stdout: | (launched: 2022-12-10_03:05:21.606994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:23.049598 run osmo-stp_10.42.42.5(pid=17544): stderr: | [0;m[38;5;43m20221210030521774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030521774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030521775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030521775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030521775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030521775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030521776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:23.176037 run osmo-stp_10.42.42.5(pid=17544): stdout: | (launched: 2022-12-10_03:05:21.606994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:23.296368 run osmo-stp_10.42.42.5(pid=17544): stderr: | [0;m[38;5;43m20221210030521774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030521774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030521775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030521775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030521775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030521775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030521776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:23.439049 run patchelf(pid=17547): Terminating (SIGINT) 03:05:23.603852 run patchelf(pid=17547): Terminated: ok {rc=0} 03:05:23.722586 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17544): Process ended prematurely: osmo-stp_10.42.42.5(pid=17544) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 03:05:23.731356 tst ping.py:22: Test FAILED (6.3 sec) 03:05:23.758190 run osmo-hlr_10.42.42.2(pid=17541): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17541)] 03:05:23.805663 run osmo-hlr_10.42.42.2(pid=17541): stdout: | (launched: 2022-12-10_03:05:20.699198) 03:05:23.854931 run osmo-hlr_10.42.42.2(pid=17541): stderr: | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030520874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030520887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030520895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030520895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030520895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:23.904612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Terminating (SIGTERM) 03:05:23.944269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Terminating (SIGTERM) 03:05:23.983944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17546): Terminating (SIGTERM) 03:05:24.023833 --- ParallelTerminationStrategy: PID 17540 died... 03:05:24.042799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Terminated: ok {rc=0} 03:05:24.086876 --- ParallelTerminationStrategy: PID 17543 died... 03:05:24.105444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Terminated: ok {rc=0} 03:05:24.149427 --- ParallelTerminationStrategy: PID 17546 died... 03:05:24.168051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17546): Terminated: ok {rc=0} 03:05:24.251848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:05:25.335598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.347259 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:25.394889 tst ping_idle_ping.py: using LAC 25549 03:05:25.511107 tst ping_idle_ping.py: using RAC 49 03:05:25.628871 tst ping_idle_ping.py: using CellId 25549 03:05:25.743400 tst ping_idle_ping.py: using BVCI 25550 03:05:25.859346 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.871003 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.882329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.894468 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.906151 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.917435 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.928628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.939945 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:26.055096 tst ping_idle_ping.py:24: start network... 03:05:26.266517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:26.753056 run create_hlr_db(pid=17548): Launched 03:05:26.880567 bus /gobi_6: Setting Powered False 03:05:27.942779 run create_hlr_db(pid=17548): Terminated: ok {rc=0} 03:05:28.363273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17550): Launched 03:05:28.656263 run osmo-hlr_10.42.42.2(pid=17551): Launched 03:05:28.768625 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:29.289914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17553): Launched 03:05:29.582080 run osmo-stp_10.42.42.5(pid=17554): Launched 03:05:29.693329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:30.198054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17556): Launched 03:05:30.310734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:30.558003 run patchelf(pid=17557): Launched 03:05:30.721956 run osmo-stp_10.42.42.5(pid=17554): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17554)] 03:05:30.856500 run osmo-stp_10.42.42.5(pid=17554): stdout: | (launched: 2022-12-10_03:05:29.528361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:30.989920 run osmo-stp_10.42.42.5(pid=17554): stderr: | [0;m[38;5;43m20221210030529699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030529699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030529700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030529700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:31.120529 run osmo-stp_10.42.42.5(pid=17554): stdout: | (launched: 2022-12-10_03:05:29.528361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:31.244606 run osmo-stp_10.42.42.5(pid=17554): stderr: | [0;m[38;5;43m20221210030529699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030529699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030529700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030529700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030529701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:31.391458 run patchelf(pid=17557): Terminating (SIGINT) 03:05:31.561228 run patchelf(pid=17557): Terminated: ok {rc=0} 03:05:31.683516 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17554): Process ended prematurely: osmo-stp_10.42.42.5(pid=17554) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17554)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 03:05:31.693506 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 03:05:31.723517 run osmo-hlr_10.42.42.2(pid=17551): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17551)] 03:05:31.773527 run osmo-hlr_10.42.42.2(pid=17551): stdout: | (launched: 2022-12-10_03:05:28.602930) 03:05:31.825310 run osmo-hlr_10.42.42.2(pid=17551): stderr: | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030528777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030528789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030528798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030528798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030528798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:31.877476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17550): Terminating (SIGTERM) 03:05:31.919936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17553): Terminating (SIGTERM) 03:05:31.963245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17556): Terminating (SIGTERM) 03:05:32.005727 --- ParallelTerminationStrategy: PID 17550 died... 03:05:32.025068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17550): Terminated: ok {rc=0} 03:05:32.072003 --- ParallelTerminationStrategy: PID 17553 died... 03:05:32.091595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17553): Terminated: ok {rc=0} 03:05:32.138497 --- ParallelTerminationStrategy: PID 17556 died... 03:05:32.157837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17556): Terminated: ok {rc=0} 03:05:32.245085 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:05:33.543212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:05:33.549165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:05:33.578949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:05:33.618160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:05:33.704428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:05:33.733475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:05:33.771739 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:05:34.367679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:05:34.416686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:34.427876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:05:34.493433 tst cs_paging_gprs_active.py: using LAC 25550 03:05:34.620476 tst cs_paging_gprs_active.py: using RAC 50 03:05:34.745353 tst cs_paging_gprs_active.py: using CellId 25550 03:05:34.872272 tst cs_paging_gprs_active.py: using BVCI 25551 03:05:34.990003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.001654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.013047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.024519 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.035825 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.047021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.058352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.069560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:35.080892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:35.196230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:35.311175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:05:35.512157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:35.812429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Launched 03:05:36.072529 run iperf3-srv_10.42.42.10(pid=17562): Launched 03:05:36.185894 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:05:36.385229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:36.684319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Launched 03:05:36.944790 run iperf3-srv_10.42.42.10(pid=17564): Launched 03:05:37.057922 tst cs_paging_gprs_active.py:38: start network... 03:05:37.258019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:37.720936 run create_hlr_db(pid=17565): Launched 03:05:37.837522 bus /gobi_6: Setting Powered False 03:05:38.897116 run create_hlr_db(pid=17565): Terminated: ok {rc=0} 03:05:39.314084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17567): Launched 03:05:39.614741 run osmo-hlr_10.42.42.2(pid=17568): Launched 03:05:39.729570 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:40.242296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17570): Launched 03:05:40.541266 run osmo-stp_10.42.42.5(pid=17571): Launched 03:05:40.656344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:41.171230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17573): Launched 03:05:41.286824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:41.539520 run patchelf(pid=17574): Launched 03:05:41.706662 run osmo-stp_10.42.42.5(pid=17571): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17571)] 03:05:41.833671 run osmo-stp_10.42.42.5(pid=17571): stdout: | (launched: 2022-12-10_03:05:40.486494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:41.962390 run osmo-stp_10.42.42.5(pid=17571): stderr: | [0;m[38;5;43m20221210030540658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030540658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030540659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030540659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030540659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030540660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030540660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:42.090702 run osmo-stp_10.42.42.5(pid=17571): stdout: | (launched: 2022-12-10_03:05:40.486494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:42.213510 run osmo-stp_10.42.42.5(pid=17571): stderr: | [0;m[38;5;43m20221210030540658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030540658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030540659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030540659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030540659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030540660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030540660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:42.359222 run patchelf(pid=17574): Terminating (SIGINT) 03:05:42.527299 run patchelf(pid=17574): Terminated: ok {rc=0} 03:05:42.648797 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17571): Process ended prematurely: osmo-stp_10.42.42.5(pid=17571) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17571)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:05:42.658509 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 03:05:42.686168 run osmo-hlr_10.42.42.2(pid=17568): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17568)] 03:05:42.734723 run osmo-hlr_10.42.42.2(pid=17568): stdout: | (launched: 2022-12-10_03:05:39.559666) 03:05:42.784387 run osmo-hlr_10.42.42.2(pid=17568): stderr: | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030539737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030539749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030539758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030539758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030539758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:42.834711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminating (SIGTERM) 03:05:42.874881 run iperf3-srv_10.42.42.10(pid=17562): Terminating (SIGTERM) 03:05:42.914950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Terminating (SIGTERM) 03:05:42.955176 run iperf3-srv_10.42.42.10(pid=17564): Terminating (SIGTERM) 03:05:42.995216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17567): Terminating (SIGTERM) 03:05:43.035404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17570): Terminating (SIGTERM) 03:05:43.075577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17573): Terminating (SIGTERM) 03:05:43.115976 --- ParallelTerminationStrategy: PID 17561 died... 03:05:43.134994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminated: ok {rc=0} 03:05:43.179645 --- ParallelTerminationStrategy: PID 17562 died... 03:05:43.198249 run iperf3-srv_10.42.42.10(pid=17562): Terminated {rc=256} 03:05:43.243157 --- ParallelTerminationStrategy: PID 17563 died... 03:05:43.261598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Terminated: ok {rc=0} 03:05:43.305308 --- ParallelTerminationStrategy: PID 17564 died... 03:05:43.323620 run iperf3-srv_10.42.42.10(pid=17564): Terminated {rc=256} 03:05:43.368044 --- ParallelTerminationStrategy: PID 17567 died... 03:05:43.386627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17567): Terminated: ok {rc=0} 03:05:43.430461 --- ParallelTerminationStrategy: PID 17570 died... 03:05:43.448941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17570): Terminated: ok {rc=0} 03:05:43.492867 --- ParallelTerminationStrategy: PID 17573 died... 03:05:43.511702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17573): Terminated: ok {rc=0} 03:05:43.595325 bus /gobi_0: Setting Powered False 03:05:44.693366 bus /gobi_0: Setting Powered False 03:05:45.807450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:05:46.968485 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:46.981097 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:05:47.051335 tst iperf3.py: using LAC 25551 03:05:47.171212 tst iperf3.py: using RAC 51 03:05:47.309763 tst iperf3.py: using CellId 25551 03:05:47.439106 tst iperf3.py: using BVCI 25552 03:05:47.555134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.566791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.578392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.590282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.601853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.613663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.625497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.636880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:47.648612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:47.767816 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:47.982292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:48.300734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17576): Launched 03:05:48.579657 run iperf3-srv_10.42.42.10(pid=17577): Launched 03:05:48.700543 tst iperf3.py:8: start network... 03:05:48.916022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:49.412039 run create_hlr_db(pid=17578): Launched 03:05:49.541741 bus /gobi_6: Setting Powered False 03:05:50.605116 run create_hlr_db(pid=17578): Terminated: ok {rc=0} 03:05:51.030293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17580): Launched 03:05:51.329713 run osmo-hlr_10.42.42.2(pid=17581): Launched 03:05:51.444043 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:51.974287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17583): Launched 03:05:52.273160 run osmo-stp_10.42.42.5(pid=17584): Launched 03:05:52.388169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:52.904522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17586): Launched 03:05:53.020367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:53.273219 run patchelf(pid=17587): Launched 03:05:53.440214 run osmo-stp_10.42.42.5(pid=17584): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17584)] 03:05:53.567063 run osmo-stp_10.42.42.5(pid=17584): stdout: | (launched: 2022-12-10_03:05:52.218496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:53.695575 run osmo-stp_10.42.42.5(pid=17584): stderr: | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030552386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:53.824169 run osmo-stp_10.42.42.5(pid=17584): stdout: | (launched: 2022-12-10_03:05:52.218496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:53.947410 run osmo-stp_10.42.42.5(pid=17584): stderr: | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030552386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030552386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030552389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:54.093287 run patchelf(pid=17587): Terminating (SIGINT) 03:05:54.262074 run patchelf(pid=17587): Terminated: ok {rc=0} 03:05:54.383436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17584): Process ended prematurely: osmo-stp_10.42.42.5(pid=17584) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17584)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 03:05:54.392735 tst iperf3.py:8: Test FAILED (7.5 sec) 03:05:54.420191 run osmo-hlr_10.42.42.2(pid=17581): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17581)] 03:05:54.467561 run osmo-hlr_10.42.42.2(pid=17581): stdout: | (launched: 2022-12-10_03:05:51.275131) 03:05:54.516778 run osmo-hlr_10.42.42.2(pid=17581): stderr: | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030551452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030551469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030551479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030551479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030551479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:54.566445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17576): Terminating (SIGTERM) 03:05:54.606175 run iperf3-srv_10.42.42.10(pid=17577): Terminating (SIGTERM) 03:05:54.645766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17580): Terminating (SIGTERM) 03:05:54.685382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17583): Terminating (SIGTERM) 03:05:54.725316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17586): Terminating (SIGTERM) 03:05:54.765285 --- ParallelTerminationStrategy: PID 17576 died... 03:05:54.784097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17576): Terminated: ok {rc=0} 03:05:54.827917 --- ParallelTerminationStrategy: PID 17577 died... 03:05:54.846149 run iperf3-srv_10.42.42.10(pid=17577): Terminated {rc=256} 03:05:54.890268 --- ParallelTerminationStrategy: PID 17580 died... 03:05:54.908634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17580): Terminated: ok {rc=0} 03:05:54.952226 --- ParallelTerminationStrategy: PID 17583 died... 03:05:54.971044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17583): Terminated: ok {rc=0} 03:05:55.014948 --- ParallelTerminationStrategy: PID 17586 died... 03:05:55.033367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17586): Terminated: ok {rc=0} 03:05:55.118827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:05:56.263786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.275414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:05:56.341376 tst iperf3m4.py: using LAC 25552 03:05:56.459128 tst iperf3m4.py: using RAC 52 03:05:56.578119 tst iperf3m4.py: using CellId 25552 03:05:56.702575 tst iperf3m4.py: using BVCI 25553 03:05:56.811999 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.822984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.833924 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.844900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.856272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.867264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.878340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.889493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:56.900659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:57.018928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:57.135925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:57.252583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:57.369992 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:57.570327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:57.870098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17588): Launched 03:05:58.131424 run iperf3-srv_10.42.42.10(pid=17589): Launched 03:05:58.244597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:05:58.444327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:58.743946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17590): Launched 03:05:59.005128 run iperf3-srv_10.42.42.10(pid=17591): Launched 03:05:59.118638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:05:59.318474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:59.619389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17592): Launched 03:05:59.881183 run iperf3-srv_10.42.42.10(pid=17593): Launched 03:05:59.994432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:06:00.194877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:00.494896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17594): Launched 03:06:00.755684 run iperf3-srv_10.42.42.10(pid=17595): Launched 03:06:00.881714 tst iperf3m4.py:8: start network... 03:06:01.107613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:01.629348 run create_hlr_db(pid=17596): Launched 03:06:01.792489 bus /gobi_6: Setting Powered False 03:06:02.856109 run create_hlr_db(pid=17596): Terminated: ok {rc=0} 03:06:03.300621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Launched 03:06:03.620467 run osmo-hlr_10.42.42.2(pid=17599): Launched 03:06:03.743018 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:04.294288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Launched 03:06:04.613223 run osmo-stp_10.42.42.5(pid=17602): Launched 03:06:04.736571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:05.287811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Launched 03:06:05.410583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:05.679447 run patchelf(pid=17605): Launched 03:06:05.857522 run osmo-stp_10.42.42.5(pid=17602): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] 03:06:05.992153 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-10_03:06:04.555106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:06.128483 run osmo-stp_10.42.42.5(pid=17602): stderr: | [0;m[38;5;43m20221210030604747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030604747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030604748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030604748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:06.264474 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-10_03:06:04.555106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:06.395292 run osmo-stp_10.42.42.5(pid=17602): stderr: | [0;m[38;5;43m20221210030604747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030604747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030604748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030604748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030604749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:06.550253 run patchelf(pid=17605): Terminating (SIGINT) 03:06:06.728763 run patchelf(pid=17605): Terminated: ok {rc=0} 03:06:06.857916 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:06:06.867903 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:06:06.896061 run osmo-hlr_10.42.42.2(pid=17599): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17599)] 03:06:06.945402 run osmo-hlr_10.42.42.2(pid=17599): stdout: | (launched: 2022-12-10_03:06:03.562323) 03:06:06.996733 run osmo-hlr_10.42.42.2(pid=17599): stderr: | [0;m[1;31m20221210030603761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030603761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030603761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030603762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030603762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030603762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030603774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030603782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030603782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030603783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:07.048308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17588): Terminating (SIGTERM) 03:06:07.089761 run iperf3-srv_10.42.42.10(pid=17589): Terminating (SIGTERM) 03:06:07.131299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17590): Terminating (SIGTERM) 03:06:07.172886 run iperf3-srv_10.42.42.10(pid=17591): Terminating (SIGTERM) 03:06:07.214212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17592): Terminating (SIGTERM) 03:06:07.255752 run iperf3-srv_10.42.42.10(pid=17593): Terminating (SIGTERM) 03:06:07.297131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17594): Terminating (SIGTERM) 03:06:07.338748 run iperf3-srv_10.42.42.10(pid=17595): Terminating (SIGTERM) 03:06:07.380314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminating (SIGTERM) 03:06:07.422090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminating (SIGTERM) 03:06:07.463735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Terminating (SIGTERM) 03:06:07.505464 --- ParallelTerminationStrategy: PID 17588 died... 03:06:07.525150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17588): Terminated: ok {rc=0} 03:06:07.571388 --- ParallelTerminationStrategy: PID 17589 died... 03:06:07.590784 run iperf3-srv_10.42.42.10(pid=17589): Terminated {rc=256} 03:06:07.636559 --- ParallelTerminationStrategy: PID 17590 died... 03:06:07.655969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17590): Terminated: ok {rc=0} 03:06:07.701784 --- ParallelTerminationStrategy: PID 17591 died... 03:06:07.720942 run iperf3-srv_10.42.42.10(pid=17591): Terminated {rc=256} 03:06:07.767345 --- ParallelTerminationStrategy: PID 17592 died... 03:06:07.786853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17592): Terminated: ok {rc=0} 03:06:07.832818 --- ParallelTerminationStrategy: PID 17593 died... 03:06:07.852622 run iperf3-srv_10.42.42.10(pid=17593): Terminated {rc=256} 03:06:07.898634 --- ParallelTerminationStrategy: PID 17594 died... 03:06:07.918216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17594): Terminated: ok {rc=0} 03:06:07.964220 --- ParallelTerminationStrategy: PID 17595 died... 03:06:07.983737 run iperf3-srv_10.42.42.10(pid=17595): Terminated {rc=256} 03:06:08.029807 --- ParallelTerminationStrategy: PID 17598 died... 03:06:08.049359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminated: ok {rc=0} 03:06:08.095342 --- ParallelTerminationStrategy: PID 17601 died... 03:06:08.114889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminated: ok {rc=0} 03:06:08.161181 --- ParallelTerminationStrategy: PID 17604 died... 03:06:08.180593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17604): Terminated: ok {rc=0} 03:06:08.267332 bus /gobi_4: Setting Powered False 03:06:09.366933 bus /gobi_4: Setting Powered False 03:06:10.484316 bus /gobi_1: Setting Powered False 03:06:11.582755 bus /gobi_1: Setting Powered False 03:06:12.698800 bus /gobi_0: Setting Powered False 03:06:13.796022 bus /gobi_0: Setting Powered False 03:06:14.914427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:06:16.016717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.029431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:16.100465 tst ping.py: using LAC 25553 03:06:16.226420 tst ping.py: using RAC 53 03:06:16.381098 tst ping.py: using CellId 25553 03:06:16.531997 tst ping.py: using BVCI 25554 03:06:16.642126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.655359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.668345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.681471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.693499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.706587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.720697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:16.733800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:16.851750 tst ping.py:19: start network... 03:06:17.057300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:17.519606 run create_hlr_db(pid=17606): Launched 03:06:17.633647 bus /gobi_6: Setting Powered False 03:06:18.693052 run create_hlr_db(pid=17606): Terminated: ok {rc=0} 03:06:19.102601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Launched 03:06:19.396218 run osmo-hlr_10.42.42.2(pid=17609): Launched 03:06:19.508763 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:20.014450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Launched 03:06:20.306737 run osmo-stp_10.42.42.5(pid=17612): Launched 03:06:20.420118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:20.925295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Launched 03:06:21.038708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:21.285681 run patchelf(pid=17615): Launched 03:06:21.449338 run osmo-stp_10.42.42.5(pid=17612): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] 03:06:21.574451 run osmo-stp_10.42.42.5(pid=17612): stdout: | (launched: 2022-12-10_03:06:20.253473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:21.700294 run osmo-stp_10.42.42.5(pid=17612): stderr: | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030620422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:21.826121 run osmo-stp_10.42.42.5(pid=17612): stdout: | (launched: 2022-12-10_03:06:20.253473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:21.974739 run osmo-stp_10.42.42.5(pid=17612): stderr: | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030620421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030620422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030620422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:22.127394 run patchelf(pid=17615): Terminating (SIGINT) 03:06:22.303311 run patchelf(pid=17615): Terminated: ok {rc=0} 03:06:22.429805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17612): Process ended prematurely: osmo-stp_10.42.42.5(pid=17612) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 03:06:22.439280 tst ping.py:22: Test FAILED (6.4 sec) 03:06:22.467168 run osmo-hlr_10.42.42.2(pid=17609): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17609)] 03:06:22.516732 run osmo-hlr_10.42.42.2(pid=17609): stdout: | (launched: 2022-12-10_03:06:19.342332) 03:06:22.568362 run osmo-hlr_10.42.42.2(pid=17609): stderr: | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030619519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030619531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030619539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030619540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030619540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:22.620358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Terminating (SIGTERM) 03:06:22.661718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Terminating (SIGTERM) 03:06:22.703021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Terminating (SIGTERM) 03:06:22.744456 --- ParallelTerminationStrategy: PID 17608 died... 03:06:22.764398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17608): Terminated: ok {rc=0} 03:06:22.810236 --- ParallelTerminationStrategy: PID 17611 died... 03:06:22.829707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17611): Terminated: ok {rc=0} 03:06:22.875111 --- ParallelTerminationStrategy: PID 17614 died... 03:06:22.894465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17614): Terminated: ok {rc=0} 03:06:22.981906 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:06:24.070415 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.082917 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:24.151107 tst ping_idle_ping.py: using LAC 25554 03:06:24.275222 tst ping_idle_ping.py: using RAC 54 03:06:24.398526 tst ping_idle_ping.py: using CellId 25554 03:06:24.522572 tst ping_idle_ping.py: using BVCI 25555 03:06:24.636294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.647843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.659134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.670412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.681744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.693031 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.704346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.715578 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:24.831476 tst ping_idle_ping.py:24: start network... 03:06:25.029248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:25.488430 run create_hlr_db(pid=17616): Launched 03:06:25.602096 bus /gobi_6: Setting Powered False 03:06:26.661085 run create_hlr_db(pid=17616): Terminated: ok {rc=0} 03:06:27.090682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17618): Launched 03:06:27.404325 run osmo-hlr_10.42.42.2(pid=17619): Launched 03:06:27.525628 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:28.072799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Launched 03:06:28.386800 run osmo-stp_10.42.42.5(pid=17622): Launched 03:06:28.506802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:29.050188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Launched 03:06:29.171298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:29.437333 run patchelf(pid=17625): Launched 03:06:29.613739 run osmo-stp_10.42.42.5(pid=17622): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] 03:06:29.747106 run osmo-stp_10.42.42.5(pid=17622): stdout: | (launched: 2022-12-10_03:06:28.329678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:29.882526 run osmo-stp_10.42.42.5(pid=17622): stderr: | [0;m[38;5;43m20221210030628519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030628519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030628520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030628520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030628520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030628520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030628521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:30.017392 run osmo-stp_10.42.42.5(pid=17622): stdout: | (launched: 2022-12-10_03:06:28.329678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:30.146682 run osmo-stp_10.42.42.5(pid=17622): stderr: | [0;m[38;5;43m20221210030628519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030628519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030628520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030628520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030628520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030628520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030628521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:30.299580 run patchelf(pid=17625): Terminating (SIGINT) 03:06:30.476160 run patchelf(pid=17625): Terminated: ok {rc=0} 03:06:30.603370 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17622): Process ended prematurely: osmo-stp_10.42.42.5(pid=17622) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:06:30.612692 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:06:30.640500 run osmo-hlr_10.42.42.2(pid=17619): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17619)] 03:06:30.689830 run osmo-hlr_10.42.42.2(pid=17619): stdout: | (launched: 2022-12-10_03:06:27.347249) 03:06:30.740809 run osmo-hlr_10.42.42.2(pid=17619): stderr: | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030627544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030627556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030627565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030627565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030627565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:30.792763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17618): Terminating (SIGTERM) 03:06:30.844211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Terminating (SIGTERM) 03:06:30.894819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Terminating (SIGTERM) 03:06:30.939014 --- ParallelTerminationStrategy: PID 17618 died... 03:06:30.959084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17618): Terminated: ok {rc=0} 03:06:31.005787 --- ParallelTerminationStrategy: PID 17621 died... 03:06:31.026157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Terminated: ok {rc=0} 03:06:31.073286 --- ParallelTerminationStrategy: PID 17624 died... 03:06:31.093971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Terminated: ok {rc=0} 03:06:31.182636 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:06:32.477579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:06:32.483266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:06:32.512941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:06:32.551678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:06:32.638109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:06:32.667511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:06:32.705785 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:06:33.301761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:06:33.350053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.361134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:06:33.426499 tst cs_paging_gprs_active.py: using LAC 25555 03:06:33.543950 tst cs_paging_gprs_active.py: using RAC 55 03:06:33.664583 tst cs_paging_gprs_active.py: using CellId 25555 03:06:33.782202 tst cs_paging_gprs_active.py: using BVCI 25556 03:06:33.893199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.904230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.915482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.926558 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.937617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.948526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.959695 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.970642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:33.981858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:34.102583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:34.223888 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:06:34.439082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:34.759840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17630): Launched 03:06:35.038406 run iperf3-srv_10.42.42.10(pid=17631): Launched 03:06:35.158853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:06:35.374395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:35.698567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17632): Launched 03:06:35.977733 run iperf3-srv_10.42.42.10(pid=17633): Launched 03:06:36.099206 tst cs_paging_gprs_active.py:38: start network... 03:06:36.315424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:36.813828 run create_hlr_db(pid=17634): Launched 03:06:36.945937 bus /gobi_6: Setting Powered False 03:06:38.009200 run create_hlr_db(pid=17634): Terminated: ok {rc=0} 03:06:38.436030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17636): Launched 03:06:38.735989 run osmo-hlr_10.42.42.2(pid=17637): Launched 03:06:38.851584 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:39.380730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17639): Launched 03:06:39.680788 run osmo-stp_10.42.42.5(pid=17640): Launched 03:06:39.796374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:40.309972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17642): Launched 03:06:40.424183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:40.682024 run patchelf(pid=17643): Launched 03:06:40.849818 run osmo-stp_10.42.42.5(pid=17640): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17640)] 03:06:40.977138 run osmo-stp_10.42.42.5(pid=17640): stdout: | (launched: 2022-12-10_03:06:39.625572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:41.106232 run osmo-stp_10.42.42.5(pid=17640): stderr: | [0;m[38;5;43m20221210030639796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030639797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030639797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030639797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:41.234984 run osmo-stp_10.42.42.5(pid=17640): stdout: | (launched: 2022-12-10_03:06:39.625572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:41.358036 run osmo-stp_10.42.42.5(pid=17640): stderr: | [0;m[38;5;43m20221210030639796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030639797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030639797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030639797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030639798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:41.504250 run patchelf(pid=17643): Terminating (SIGINT) 03:06:41.673684 run patchelf(pid=17643): Terminated: ok {rc=0} 03:06:41.796252 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17640): Process ended prematurely: osmo-stp_10.42.42.5(pid=17640) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17640)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:06:41.805823 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:06:41.833225 run osmo-hlr_10.42.42.2(pid=17637): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17637)] 03:06:41.881144 run osmo-hlr_10.42.42.2(pid=17637): stdout: | (launched: 2022-12-10_03:06:38.681225) 03:06:41.930709 run osmo-hlr_10.42.42.2(pid=17637): stderr: | [0;m[1;31m20221210030638856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030638856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030638856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030638857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030638857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030638857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030638868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030638877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030638877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030638877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:41.980648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17630): Terminating (SIGTERM) 03:06:42.020562 run iperf3-srv_10.42.42.10(pid=17631): Terminating (SIGTERM) 03:06:42.060218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17632): Terminating (SIGTERM) 03:06:42.100082 run iperf3-srv_10.42.42.10(pid=17633): Terminating (SIGTERM) 03:06:42.139743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17636): Terminating (SIGTERM) 03:06:42.179416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17639): Terminating (SIGTERM) 03:06:42.219146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17642): Terminating (SIGTERM) 03:06:42.259167 --- ParallelTerminationStrategy: PID 17630 died... 03:06:42.278160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17630): Terminated: ok {rc=0} 03:06:42.322259 --- ParallelTerminationStrategy: PID 17631 died... 03:06:42.340515 run iperf3-srv_10.42.42.10(pid=17631): Terminated {rc=256} 03:06:42.384662 --- ParallelTerminationStrategy: PID 17632 died... 03:06:42.403168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17632): Terminated: ok {rc=0} 03:06:42.447576 --- ParallelTerminationStrategy: PID 17633 died... 03:06:42.466095 run iperf3-srv_10.42.42.10(pid=17633): Terminated {rc=256} 03:06:42.510059 --- ParallelTerminationStrategy: PID 17636 died... 03:06:42.528673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17636): Terminated: ok {rc=0} 03:06:42.572919 --- ParallelTerminationStrategy: PID 17639 died... 03:06:42.591615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17639): Terminated: ok {rc=0} 03:06:42.635892 --- ParallelTerminationStrategy: PID 17642 died... 03:06:42.654571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17642): Terminated: ok {rc=0} 03:06:42.737920 bus /gobi_0: Setting Powered False 03:06:43.835585 bus /gobi_0: Setting Powered False 03:06:44.951414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:06:46.116776 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.129602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:06:46.198245 tst iperf3.py: using LAC 25556 03:06:46.359076 tst iperf3.py: using RAC 56 03:06:46.485197 tst iperf3.py: using CellId 25556 03:06:46.638188 tst iperf3.py: using BVCI 25557 03:06:46.787133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.802229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.818938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.835379 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.853275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.869630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.886445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.902597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:46.917292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:47.066396 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:47.319598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:47.622486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Launched 03:06:47.884353 run iperf3-srv_10.42.42.10(pid=17645): Launched 03:06:47.998009 tst iperf3.py:8: start network... 03:06:48.198147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:48.661167 run create_hlr_db(pid=17646): Launched 03:06:48.776660 bus /gobi_6: Setting Powered False 03:06:49.836829 run create_hlr_db(pid=17646): Terminated: ok {rc=0} 03:06:50.253163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Launched 03:06:50.573260 run osmo-hlr_10.42.42.2(pid=17649): Launched 03:06:50.697966 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:51.243487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Launched 03:06:51.546751 run osmo-stp_10.42.42.5(pid=17652): Launched 03:06:51.662602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:52.181406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Launched 03:06:52.296728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:52.550307 run patchelf(pid=17655): Launched 03:06:52.717418 run osmo-stp_10.42.42.5(pid=17652): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] 03:06:52.844101 run osmo-stp_10.42.42.5(pid=17652): stdout: | (launched: 2022-12-10_03:06:51.491515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:52.972375 run osmo-stp_10.42.42.5(pid=17652): stderr: | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030651660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:53.101225 run osmo-stp_10.42.42.5(pid=17652): stdout: | (launched: 2022-12-10_03:06:51.491515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:53.224355 run osmo-stp_10.42.42.5(pid=17652): stderr: | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030651660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030651660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030651663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:53.370622 run patchelf(pid=17655): Terminating (SIGINT) 03:06:53.539323 run patchelf(pid=17655): Terminated: ok {rc=0} 03:06:53.660550 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17652): Process ended prematurely: osmo-stp_10.42.42.5(pid=17652) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 03:06:53.670073 tst iperf3.py:8: Test FAILED (7.6 sec) 03:06:53.697441 run osmo-hlr_10.42.42.2(pid=17649): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17649)] 03:06:53.745553 run osmo-hlr_10.42.42.2(pid=17649): stdout: | (launched: 2022-12-10_03:06:50.515349) 03:06:53.794979 run osmo-hlr_10.42.42.2(pid=17649): stderr: | [0;m[1;31m20221210030650714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030650714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030650714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030650714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030650715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030650715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030650727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030650735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030650736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030650736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:53.844580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Terminating (SIGTERM) 03:06:53.884241 run iperf3-srv_10.42.42.10(pid=17645): Terminating (SIGTERM) 03:06:53.924093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Terminating (SIGTERM) 03:06:53.963806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Terminating (SIGTERM) 03:06:54.003530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Terminating (SIGTERM) 03:06:54.043514 --- ParallelTerminationStrategy: PID 17644 died... 03:06:54.062680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Terminated: ok {rc=0} 03:06:54.107533 --- ParallelTerminationStrategy: PID 17645 died... 03:06:54.126229 run iperf3-srv_10.42.42.10(pid=17645): Terminated {rc=256} 03:06:54.170599 --- ParallelTerminationStrategy: PID 17648 died... 03:06:54.189192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Terminated: ok {rc=0} 03:06:54.233496 --- ParallelTerminationStrategy: PID 17651 died... 03:06:54.252214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Terminated: ok {rc=0} 03:06:54.296570 --- ParallelTerminationStrategy: PID 17654 died... 03:06:54.315323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Terminated: ok {rc=0} 03:06:54.399561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:06:55.543027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:55.554604 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:06:55.621062 tst iperf3m4.py: using LAC 25557 03:06:55.737635 tst iperf3m4.py: using RAC 57 03:06:55.863752 tst iperf3m4.py: using CellId 25557 03:06:55.981376 tst iperf3m4.py: using BVCI 25558 03:06:56.088939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.099978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.110915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.122125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.133267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.144204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.155359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.166304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:56.177535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:56.299040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:56.418763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:56.538698 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:56.659768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:56.875421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:57.195557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17656): Launched 03:06:57.473698 run iperf3-srv_10.42.42.10(pid=17657): Launched 03:06:57.595543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:06:57.811700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:58.133177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17658): Launched 03:06:58.410708 run iperf3-srv_10.42.42.10(pid=17659): Launched 03:06:58.530806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:06:58.744823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:59.065410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17660): Launched 03:06:59.344553 run iperf3-srv_10.42.42.10(pid=17661): Launched 03:06:59.465289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:06:59.680425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:00.002308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17662): Launched 03:07:00.280273 run iperf3-srv_10.42.42.10(pid=17663): Launched 03:07:00.401337 tst iperf3m4.py:8: start network... 03:07:00.615632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:01.143764 run create_hlr_db(pid=17664): Launched 03:07:01.279204 bus /gobi_6: Setting Powered False 03:07:02.338316 run create_hlr_db(pid=17664): Terminated: ok {rc=0} 03:07:02.775872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17666): Launched 03:07:03.096480 run osmo-hlr_10.42.42.2(pid=17667): Launched 03:07:03.218979 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:03.776074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17669): Launched 03:07:04.097548 run osmo-stp_10.42.42.5(pid=17670): Launched 03:07:04.219621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:04.773030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17672): Launched 03:07:04.895819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:05.165336 run patchelf(pid=17673): Launched 03:07:05.343221 run osmo-stp_10.42.42.5(pid=17670): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17670)] 03:07:05.478700 run osmo-stp_10.42.42.5(pid=17670): stdout: | (launched: 2022-12-10_03:07:04.038899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:05.615472 run osmo-stp_10.42.42.5(pid=17670): stderr: | [0;m[38;5;43m20221210030704230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030704230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030704231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030704231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030704233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030704234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030704234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:05.752558 run osmo-stp_10.42.42.5(pid=17670): stdout: | (launched: 2022-12-10_03:07:04.038899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:05.884867 run osmo-stp_10.42.42.5(pid=17670): stderr: | [0;m[38;5;43m20221210030704230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030704230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030704231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030704231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030704233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030704234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030704234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:06.040399 run patchelf(pid=17673): Terminating (SIGINT) 03:07:06.220146 run patchelf(pid=17673): Terminated: ok {rc=0} 03:07:06.349342 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17670): Process ended prematurely: osmo-stp_10.42.42.5(pid=17670) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17670)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:07:06.359483 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:07:06.388030 run osmo-hlr_10.42.42.2(pid=17667): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17667)] 03:07:06.437934 run osmo-hlr_10.42.42.2(pid=17667): stdout: | (launched: 2022-12-10_03:07:03.038007) 03:07:06.489062 run osmo-hlr_10.42.42.2(pid=17667): stderr: | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030703238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030703250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030703259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030703259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030703259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:06.540455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17656): Terminating (SIGTERM) 03:07:06.581868 run iperf3-srv_10.42.42.10(pid=17657): Terminating (SIGTERM) 03:07:06.623262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17658): Terminating (SIGTERM) 03:07:06.664904 run iperf3-srv_10.42.42.10(pid=17659): Terminating (SIGTERM) 03:07:06.706687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17660): Terminating (SIGTERM) 03:07:06.748182 run iperf3-srv_10.42.42.10(pid=17661): Terminating (SIGTERM) 03:07:06.789868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17662): Terminating (SIGTERM) 03:07:06.831438 run iperf3-srv_10.42.42.10(pid=17663): Terminating (SIGTERM) 03:07:06.873012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17666): Terminating (SIGTERM) 03:07:06.914521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17669): Terminating (SIGTERM) 03:07:06.955970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17672): Terminating (SIGTERM) 03:07:06.997850 --- ParallelTerminationStrategy: PID 17656 died... 03:07:07.017841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17656): Terminated: ok {rc=0} 03:07:07.064105 --- ParallelTerminationStrategy: PID 17657 died... 03:07:07.083711 run iperf3-srv_10.42.42.10(pid=17657): Terminated {rc=256} 03:07:07.129450 --- ParallelTerminationStrategy: PID 17658 died... 03:07:07.149056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17658): Terminated: ok {rc=0} 03:07:07.194711 --- ParallelTerminationStrategy: PID 17659 died... 03:07:07.214261 run iperf3-srv_10.42.42.10(pid=17659): Terminated {rc=256} 03:07:07.259803 --- ParallelTerminationStrategy: PID 17660 died... 03:07:07.279194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17660): Terminated: ok {rc=0} 03:07:07.325298 --- ParallelTerminationStrategy: PID 17661 died... 03:07:07.344845 run iperf3-srv_10.42.42.10(pid=17661): Terminated {rc=256} 03:07:07.390429 --- ParallelTerminationStrategy: PID 17662 died... 03:07:07.410011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17662): Terminated: ok {rc=0} 03:07:07.455721 --- ParallelTerminationStrategy: PID 17663 died... 03:07:07.475143 run iperf3-srv_10.42.42.10(pid=17663): Terminated {rc=256} 03:07:07.520765 --- ParallelTerminationStrategy: PID 17666 died... 03:07:07.540326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17666): Terminated: ok {rc=0} 03:07:07.586015 --- ParallelTerminationStrategy: PID 17669 died... 03:07:07.605582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17669): Terminated: ok {rc=0} 03:07:07.651428 --- ParallelTerminationStrategy: PID 17672 died... 03:07:07.671232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17672): Terminated: ok {rc=0} 03:07:07.758796 bus /gobi_4: Setting Powered False 03:07:08.858733 bus /gobi_4: Setting Powered False 03:07:09.976147 bus /gobi_1: Setting Powered False 03:07:11.074773 bus /gobi_1: Setting Powered False 03:07:12.187086 bus /gobi_0: Setting Powered False 03:07:13.285805 bus /gobi_0: Setting Powered False 03:07:14.405495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:07:15.509881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:15.522430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:15.590890 tst ping.py: using LAC 25558 03:07:15.715400 tst ping.py: using RAC 58 03:07:15.844241 tst ping.py: using CellId 25558 03:07:15.979482 tst ping.py: using BVCI 25559 03:07:16.095922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.108499 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.120735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.133463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.145240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.157112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.168872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:16.180713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:16.298748 tst ping.py:19: start network... 03:07:16.503669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:16.981612 run create_hlr_db(pid=17675): Launched 03:07:17.114043 bus /gobi_6: Setting Powered False 03:07:18.172637 run create_hlr_db(pid=17675): Terminated: ok {rc=0} 03:07:18.584465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Launched 03:07:18.878104 run osmo-hlr_10.42.42.2(pid=17678): Launched 03:07:18.989277 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:19.510139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Launched 03:07:19.804334 run osmo-stp_10.42.42.5(pid=17681): Launched 03:07:19.916563 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:20.423769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Launched 03:07:20.536667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:20.785374 run patchelf(pid=17684): Launched 03:07:20.950542 run osmo-stp_10.42.42.5(pid=17681): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] 03:07:21.075576 run osmo-stp_10.42.42.5(pid=17681): stdout: | (launched: 2022-12-10_03:07:19.750403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:21.202059 run osmo-stp_10.42.42.5(pid=17681): stderr: | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030719921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:21.328474 run osmo-stp_10.42.42.5(pid=17681): stdout: | (launched: 2022-12-10_03:07:19.750403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:21.449276 run osmo-stp_10.42.42.5(pid=17681): stderr: | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030719920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030719921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030719921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:21.592288 run patchelf(pid=17684): Terminating (SIGINT) 03:07:21.758179 run patchelf(pid=17684): Terminated: ok {rc=0} 03:07:21.878120 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17681): Process ended prematurely: osmo-stp_10.42.42.5(pid=17681) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 03:07:21.887148 tst ping.py:22: Test FAILED (6.4 sec) 03:07:21.914204 run osmo-hlr_10.42.42.2(pid=17678): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17678)] 03:07:21.961649 run osmo-hlr_10.42.42.2(pid=17678): stdout: | (launched: 2022-12-10_03:07:18.824338) 03:07:22.011299 run osmo-hlr_10.42.42.2(pid=17678): stderr: | [0;m[1;31m20221210030718996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030718996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030718996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030718996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030718996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030718997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030719009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030719018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030719018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030719018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:22.061754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Terminating (SIGTERM) 03:07:22.101568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Terminating (SIGTERM) 03:07:22.141464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Terminating (SIGTERM) 03:07:22.181692 --- ParallelTerminationStrategy: PID 17677 died... 03:07:22.200571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17677): Terminated: ok {rc=0} 03:07:22.245474 --- ParallelTerminationStrategy: PID 17680 died... 03:07:22.263963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17680): Terminated: ok {rc=0} 03:07:22.308133 --- ParallelTerminationStrategy: PID 17683 died... 03:07:22.326857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17683): Terminated: ok {rc=0} 03:07:22.413849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:07:23.505053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.517414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:23.585329 tst ping_idle_ping.py: using LAC 25559 03:07:23.702820 tst ping_idle_ping.py: using RAC 59 03:07:23.820153 tst ping_idle_ping.py: using CellId 25559 03:07:23.935911 tst ping_idle_ping.py: using BVCI 25560 03:07:24.043925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.055285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.066139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.077983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.089477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.101201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.113280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:24.124720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:24.245767 tst ping_idle_ping.py:24: start network... 03:07:24.458888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:24.950003 run create_hlr_db(pid=17685): Launched 03:07:25.079791 bus /gobi_6: Setting Powered False 03:07:26.142373 run create_hlr_db(pid=17685): Terminated: ok {rc=0} 03:07:26.566480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17687): Launched 03:07:26.863293 run osmo-hlr_10.42.42.2(pid=17688): Launched 03:07:26.976450 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:27.499581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17690): Launched 03:07:27.793917 run osmo-stp_10.42.42.5(pid=17691): Launched 03:07:27.905876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:28.414013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17693): Launched 03:07:28.527311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:28.776611 run patchelf(pid=17694): Launched 03:07:28.941781 run osmo-stp_10.42.42.5(pid=17691): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17691)] 03:07:29.066553 run osmo-stp_10.42.42.5(pid=17691): stdout: | (launched: 2022-12-10_03:07:27.739683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:29.192858 run osmo-stp_10.42.42.5(pid=17691): stderr: | [0;m[38;5;43m20221210030727908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030727909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030727909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030727909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:29.319277 run osmo-stp_10.42.42.5(pid=17691): stdout: | (launched: 2022-12-10_03:07:27.739683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:29.439918 run osmo-stp_10.42.42.5(pid=17691): stderr: | [0;m[38;5;43m20221210030727908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030727909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030727909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030727909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030727910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:29.582877 run patchelf(pid=17694): Terminating (SIGINT) 03:07:29.748644 run patchelf(pid=17694): Terminated: ok {rc=0} 03:07:29.867748 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17691): Process ended prematurely: osmo-stp_10.42.42.5(pid=17691) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17691)] [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:07:29.876579 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:07:29.903800 run osmo-hlr_10.42.42.2(pid=17688): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17688)] 03:07:29.951163 run osmo-hlr_10.42.42.2(pid=17688): stdout: | (launched: 2022-12-10_03:07:26.808905) 03:07:30.000453 run osmo-hlr_10.42.42.2(pid=17688): stderr: | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030726988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030727001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030727010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030727010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030727010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:30.050227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17687): Terminating (SIGTERM) 03:07:30.090508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17690): Terminating (SIGTERM) 03:07:30.130310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17693): Terminating (SIGTERM) 03:07:30.170292 --- ParallelTerminationStrategy: PID 17687 died... 03:07:30.189399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17687): Terminated: ok {rc=0} 03:07:30.233664 --- ParallelTerminationStrategy: PID 17690 died... 03:07:30.252071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17690): Terminated: ok {rc=0} 03:07:30.296684 --- ParallelTerminationStrategy: PID 17693 died... 03:07:30.315304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17693): Terminated: ok {rc=0} 03:07:30.400636 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:07:31.704003 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:31.711275 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:07:31.742944 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:07:31.779082 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:07:31.832345 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:07:31.867606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:07:31.914930 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:07:32.462771 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:07:32.469148 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:32.481550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:07:32.551672 tst switch_tch_pdch.py: using LAC 25560 03:07:32.675389 tst switch_tch_pdch.py: using RAC 60 03:07:32.800846 tst switch_tch_pdch.py: using CellId 25560 03:07:32.924132 tst switch_tch_pdch.py: using BVCI 25561 03:07:33.038253 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.050236 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.061887 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.073713 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.085540 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.097302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.109571 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:33.121343 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:07:33.237998 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:07:33.357237 tst switch_tch_pdch.py:51: start network... 03:07:33.567643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:34.054688 run create_hlr_db(pid=17698): Launched 03:07:34.183144 bus /gobi_6: Setting Powered False 03:07:35.245580 run create_hlr_db(pid=17698): Terminated: ok {rc=0} 03:07:35.666858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Launched 03:07:35.965524 run osmo-hlr_10.42.42.2(pid=17702): Launched 03:07:36.078477 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:36.585740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17704): Launched 03:07:36.880799 run osmo-stp_10.42.42.5(pid=17705): Launched 03:07:36.992613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:37.499691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17707): Launched 03:07:37.613165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:37.860833 run patchelf(pid=17708): Launched 03:07:38.025163 run osmo-stp_10.42.42.5(pid=17705): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17705)] 03:07:38.150548 run osmo-stp_10.42.42.5(pid=17705): stdout: | (launched: 2022-12-10_03:07:36.826801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:38.276705 run osmo-stp_10.42.42.5(pid=17705): stderr: | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030736995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:38.403099 run osmo-stp_10.42.42.5(pid=17705): stdout: | (launched: 2022-12-10_03:07:36.826801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:38.523240 run osmo-stp_10.42.42.5(pid=17705): stderr: | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030736994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030736995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030736997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:38.665772 run patchelf(pid=17708): Terminating (SIGINT) 03:07:38.831216 run patchelf(pid=17708): Terminated: ok {rc=0} 03:07:38.950322 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17705): Process ended prematurely: osmo-stp_10.42.42.5(pid=17705) [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17705)] [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:07:38.959205 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:07:38.986368 run osmo-hlr_10.42.42.2(pid=17702): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17702)] 03:07:39.033939 run osmo-hlr_10.42.42.2(pid=17702): stdout: | (launched: 2022-12-10_03:07:35.907875) 03:07:39.083361 run osmo-hlr_10.42.42.2(pid=17702): stderr: | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030736087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030736099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030736110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030736110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030736110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:39.133628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminating (SIGTERM) 03:07:39.173250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17704): Terminating (SIGTERM) 03:07:39.212842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17707): Terminating (SIGTERM) 03:07:39.252476 --- ParallelTerminationStrategy: PID 17700 died... 03:07:39.271483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17700): Terminated: ok {rc=0} 03:07:39.315754 --- ParallelTerminationStrategy: PID 17704 died... 03:07:39.334410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17704): Terminated: ok {rc=0} 03:07:39.378475 --- ParallelTerminationStrategy: PID 17707 died... 03:07:39.397031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17707): Terminated: ok {rc=0} 03:07:39.482723 bus /gobi_0: Setting Powered False 03:07:40.582543 bus /gobi_0: Setting Powered False 03:07:41.696702 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:07:42.955438 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:42.962181 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:07:42.992494 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:07:43.026688 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:07:43.079242 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:07:43.107838 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:07:43.141772 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:07:43.698876 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:07:43.703875 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:43.714987 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:07:43.780057 tst switch_tch_pdch.py: using LAC 25561 03:07:43.897721 tst switch_tch_pdch.py: using RAC 61 03:07:44.027853 tst switch_tch_pdch.py: using CellId 25561 03:07:44.150582 tst switch_tch_pdch.py: using BVCI 25562 03:07:44.265506 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.277293 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.288732 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.300265 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.311527 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.322988 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.334438 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:44.345796 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:07:44.459971 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:07:44.576381 tst switch_tch_pdch.py:51: start network... 03:07:44.787860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:45.246549 run create_hlr_db(pid=17712): Launched 03:07:45.374131 bus /gobi_6: Setting Powered False 03:07:46.435998 run create_hlr_db(pid=17712): Terminated: ok {rc=0} 03:07:46.863396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Launched 03:07:47.194979 run osmo-hlr_10.42.42.2(pid=17715): Launched 03:07:47.311142 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:47.798511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Launched 03:07:48.091645 run osmo-stp_10.42.42.5(pid=17718): Launched 03:07:48.204175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:48.685774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17720): Launched 03:07:48.799205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:49.047515 run patchelf(pid=17721): Launched 03:07:49.211446 run osmo-stp_10.42.42.5(pid=17718): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] 03:07:49.336097 run osmo-stp_10.42.42.5(pid=17718): stdout: | (launched: 2022-12-10_03:07:48.037735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:49.462453 run osmo-stp_10.42.42.5(pid=17718): stderr: | [0;m[38;5;43m20221210030748206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030748207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030748207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030748207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:49.588671 run osmo-stp_10.42.42.5(pid=17718): stdout: | (launched: 2022-12-10_03:07:48.037735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:49.709233 run osmo-stp_10.42.42.5(pid=17718): stderr: | [0;m[38;5;43m20221210030748206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030748207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030748207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030748207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030748208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:49.852370 run patchelf(pid=17721): Terminating (SIGINT) 03:07:50.017563 run patchelf(pid=17721): Terminated: ok {rc=0} 03:07:50.136327 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17718): Process ended prematurely: osmo-stp_10.42.42.5(pid=17718) [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:07:50.145086 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 03:07:50.171894 run osmo-hlr_10.42.42.2(pid=17715): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17715)] 03:07:50.220346 run osmo-hlr_10.42.42.2(pid=17715): stdout: | (launched: 2022-12-10_03:07:47.136191) 03:07:50.270272 run osmo-hlr_10.42.42.2(pid=17715): stderr: | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030747320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030747333 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030747341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030747342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030747342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:50.320392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Terminating (SIGTERM) 03:07:50.360506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Terminating (SIGTERM) 03:07:50.400539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17720): Terminating (SIGTERM) 03:07:50.440793 --- ParallelTerminationStrategy: PID 17714 died... 03:07:50.459891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17714): Terminated: ok {rc=0} 03:07:50.504202 --- ParallelTerminationStrategy: PID 17717 died... 03:07:50.522893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17717): Terminated: ok {rc=0} 03:07:50.567096 --- ParallelTerminationStrategy: PID 17720 died... 03:07:50.585761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17720): Terminated: ok {rc=0} 03:07:50.671570 bus /gobi_0: Setting Powered False 03:07:51.770443 bus /gobi_0: Setting Powered False 03:07:52.885915 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_sms:nanobts --------------------------------------------------------------------- 03:07:54.133282 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:54.136783 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 03:07:54.160412 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 03:07:54.167450 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 03:07:54.218475 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 03:07:54.241740 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 03:07:54.249244 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 03:07:54.785616 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 03:07:54.791912 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 03:07:54.804038 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 03:07:54.843483 tst mo_mt_sms.py: using LAC 25562 03:07:54.968832 tst mo_mt_sms.py: using RAC 62 03:07:55.094438 tst mo_mt_sms.py: using CellId 25562 03:07:55.217976 tst mo_mt_sms.py: using BVCI 25563 03:07:55.333716 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:07:55.448907 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:07:55.569429 tst mo_mt_sms.py:9: start nitb and bts... 03:07:55.781360 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:07:56.423681 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17725): Launched 03:07:56.738923 run osmo-nitb_10.42.42.2(pid=17726): Launched 03:07:56.913964 run osmo-nitb_10.42.42.2(pid=17726): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17726)] 03:07:57.055965 run osmo-nitb_10.42.42.2(pid=17726): stdout: | (launched: 2022-12-10_03:07:56.681958) 03:07:57.199606 run osmo-nitb_10.42.42.2(pid=17726): stderr: | (launched: 2022-12-10_03:07:56.728724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:07:57.342644 run osmo-nitb_10.42.42.2(pid=17726): stdout: | (launched: 2022-12-10_03:07:56.681958) 03:07:57.480855 run osmo-nitb_10.42.42.2(pid=17726): stderr: | (launched: 2022-12-10_03:07:56.728724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17726) [trial-2368↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17726)] 03:07:57.857887 tst osmo-nitb_10.42.42.2(pid=17726): stdout: | (launched: 2022-12-10_03:07:56.681958) 03:07:57.985565 tst osmo-nitb_10.42.42.2(pid=17726): stderr: | (launched: 2022-12-10_03:07:56.728724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:07:58.135662 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17726) [trial-2368↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17726)] [trial-2368↪nitb_sms:nanobts↪mo_mt_sms.py:11] 03:07:58.144738 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 03:07:58.151855 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17725): Terminating (SIGTERM) 03:07:58.362176 --- ParallelTerminationStrategy: PID 17725 died... 03:07:58.385055 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17725): Terminated: ok {rc=0} 03:07:58.472352 bus /sierra_3: Setting Powered False 03:07:59.571645 bus /sierra_3: Setting Powered False 03:08:00.687859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:nanobts+band-1900 --------------------------------------------------------------------- 03:08:01.870394 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:01.875676 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:01.901224 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:01.929576 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 03:08:01.981751 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:02.007212 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:02.034523 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 03:08:02.578704 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 03:08:02.583796 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:02.594577 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:02.632228 tst mo_mt_sms.py: using LAC 25563 03:08:02.747226 tst mo_mt_sms.py: using RAC 63 03:08:02.862630 tst mo_mt_sms.py: using CellId 25563 03:08:02.980128 tst mo_mt_sms.py: using BVCI 25564 03:08:03.086635 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:03.097286 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:03.107674 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:03.118447 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:03.129123 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:03.139464 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:03.257891 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:03.372936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:03.829044 run create_hlr_db(pid=17730): Launched 03:08:03.941680 bus /sierra_2: Setting Powered False 03:08:05.000203 run create_hlr_db(pid=17730): Terminated: ok {rc=0} 03:08:05.410195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17732): Launched 03:08:05.702760 run osmo-hlr_10.42.42.2(pid=17733): Launched 03:08:05.815796 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:06.319726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17735): Launched 03:08:06.614207 run osmo-stp_10.42.42.5(pid=17736): Launched 03:08:06.725847 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:07.254332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17738): Launched 03:08:07.547858 run osmo-msc_10.42.42.6(pid=17739): Launched 03:08:07.711691 run osmo-stp_10.42.42.5(pid=17736): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17736)] 03:08:07.837089 run osmo-stp_10.42.42.5(pid=17736): stdout: | (launched: 2022-12-10_03:08:06.560384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:07.962814 run osmo-stp_10.42.42.5(pid=17736): stderr: | [0;m[38;5;43m20221210030806728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030806728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030806729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030806729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:08.086130 run osmo-stp_10.42.42.5(pid=17736): stdout: | (launched: 2022-12-10_03:08:06.560384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:08.203131 run osmo-stp_10.42.42.5(pid=17736): stderr: | [0;m[38;5;43m20221210030806728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030806728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030806729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030806729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030806731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:08.342954 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17736): Process ended prematurely: osmo-stp_10.42.42.5(pid=17736) [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17736)] [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 03:08:08.351174 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 03:08:08.377538 run osmo-hlr_10.42.42.2(pid=17733): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17733)] 03:08:08.425354 run osmo-hlr_10.42.42.2(pid=17733): stdout: | (launched: 2022-12-10_03:08:05.649280) 03:08:08.474915 run osmo-hlr_10.42.42.2(pid=17733): stderr: | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030805825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030805838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030805846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030805846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030805846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:08.543526 run osmo-msc_10.42.42.6(pid=17739): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17739)] 03:08:08.591111 run osmo-msc_10.42.42.6(pid=17739): stdout: | (launched: 2022-12-10_03:08:07.494047) 03:08:08.640278 run osmo-msc_10.42.42.6(pid=17739): stderr: | [0;m[38;5;43m20221210030807766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030807766 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17343b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030807766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030807766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030807766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030807766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030807768 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030807768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030807769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030807769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:08.690165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17732): Terminating (SIGTERM) 03:08:08.729774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17735): Terminating (SIGTERM) 03:08:08.769287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17738): Terminating (SIGTERM) 03:08:08.809304 --- ParallelTerminationStrategy: PID 17732 died... 03:08:08.828374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17732): Terminated: ok {rc=0} 03:08:08.872733 --- ParallelTerminationStrategy: PID 17735 died... 03:08:08.891415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17735): Terminated: ok {rc=0} 03:08:08.935208 --- ParallelTerminationStrategy: PID 17738 died... 03:08:08.953774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17738): Terminated: ok {rc=0} 03:08:09.037419 bus /sierra_3: Setting Powered False 03:08:10.135010 bus /sierra_3: Setting Powered False 03:08:11.250724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:12.477914 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:12.482942 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:12.507243 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 03:08:12.514194 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:12.549622 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:12.573938 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 03:08:12.580795 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:13.101735 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:13.106840 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 03:08:13.118015 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:13.156323 tst assert_extension.py: using LAC 25564 03:08:13.284472 tst assert_extension.py: using RAC 64 03:08:13.408011 tst assert_extension.py: using CellId 25564 03:08:13.530035 tst assert_extension.py: using BVCI 25565 03:08:13.644311 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:13.757857 tst assert_extension.py:10: start nitb and bts... 03:08:13.954609 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:08:14.553535 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17744): Launched 03:08:14.848783 run osmo-nitb_10.42.42.2(pid=17745): Launched 03:08:15.012823 run osmo-nitb_10.42.42.2(pid=17745): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17745)] 03:08:15.146519 run osmo-nitb_10.42.42.2(pid=17745): stdout: | (launched: 2022-12-10_03:08:14.794668) 03:08:15.280926 run osmo-nitb_10.42.42.2(pid=17745): stderr: | (launched: 2022-12-10_03:08:14.838660) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:15.415665 run osmo-nitb_10.42.42.2(pid=17745): stdout: | (launched: 2022-12-10_03:08:14.794668) 03:08:15.545171 run osmo-nitb_10.42.42.2(pid=17745): stderr: | (launched: 2022-12-10_03:08:14.838660) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17745): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17745) [trial-2368↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17745)] 03:08:15.960522 tst osmo-nitb_10.42.42.2(pid=17745): stdout: | (launched: 2022-12-10_03:08:14.794668) 03:08:16.090885 tst osmo-nitb_10.42.42.2(pid=17745): stderr: | (launched: 2022-12-10_03:08:14.838660) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:16.282815 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17745): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17745) [trial-2368↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17745)] [trial-2368↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 03:08:16.298302 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:08:16.308528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17744): Terminating (SIGTERM) 03:08:16.524916 --- ParallelTerminationStrategy: PID 17744 died... 03:08:16.551449 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17744): Terminated: ok {rc=0} 03:08:16.669822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:17.883962 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:17.890067 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:17.921177 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:17.952785 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:17.996468 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:18.034654 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:18.077255 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:18.577098 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:18.583529 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:18.595118 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:18.636599 tst assert_extension.py: using LAC 25565 03:08:18.755963 tst assert_extension.py: using RAC 65 03:08:18.874738 tst assert_extension.py: using CellId 25565 03:08:18.992892 tst assert_extension.py: using BVCI 25566 03:08:19.103073 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:19.114756 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:19.126285 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:19.138660 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:19.151284 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:19.163899 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:19.283103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:19.750256 run create_hlr_db(pid=18018): Launched 03:08:19.905172 bus /sierra_2: Setting Powered False 03:08:20.968652 run create_hlr_db(pid=18018): Terminated: ok {rc=0} 03:08:21.398784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Launched 03:08:21.727353 run osmo-hlr_10.42.42.2(pid=18023): Launched 03:08:21.952837 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:22.665670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Launched 03:08:22.989708 run osmo-stp_10.42.42.5(pid=18026): Launched 03:08:23.228590 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:23.875668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Launched 03:08:24.215369 run osmo-msc_10.42.42.6(pid=18029): Launched 03:08:24.578771 run osmo-stp_10.42.42.5(pid=18026): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] 03:08:24.850819 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-10_03:08:22.921638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:25.024460 run osmo-stp_10.42.42.5(pid=18026): stderr: | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030823214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:25.159649 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-10_03:08:22.921638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:25.289473 run osmo-stp_10.42.42.5(pid=18026): stderr: | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030823213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030823214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030823214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:25.443603 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py:17] 03:08:25.453456 tst assert_extension.py:17: Test FAILED (6.9 sec) 03:08:25.482544 run osmo-hlr_10.42.42.2(pid=18023): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18023)] 03:08:25.535165 run osmo-hlr_10.42.42.2(pid=18023): stdout: | (launched: 2022-12-10_03:08:21.660264) 03:08:25.589215 run osmo-hlr_10.42.42.2(pid=18023): stderr: | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030821999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030822019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030822030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030822030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030822041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:25.664367 run osmo-msc_10.42.42.6(pid=18029): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18029)] 03:08:25.717473 run osmo-msc_10.42.42.6(pid=18029): stdout: | (launched: 2022-12-10_03:08:24.150822) 03:08:25.773296 run osmo-msc_10.42.42.6(pid=18029): stderr: | [0;m[38;5;43m20221210030824654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030824654 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8508c02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030824654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030824654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030824655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030824655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030824656 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030824657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030824657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030824657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:25.828268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminating (SIGTERM) 03:08:25.872657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminating (SIGTERM) 03:08:25.918786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Terminating (SIGTERM) 03:08:25.965301 --- ParallelTerminationStrategy: PID 18022 died... 03:08:25.986477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminated: ok {rc=0} 03:08:26.036581 --- ParallelTerminationStrategy: PID 18025 died... 03:08:26.057564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminated: ok {rc=0} 03:08:26.106093 --- ParallelTerminationStrategy: PID 18028 died... 03:08:26.127032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18028): Terminated: ok {rc=0} 03:08:26.217753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:08:27.427241 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:27.437509 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:08:27.463124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:08:27.494010 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:08:27.546449 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:08:27.571966 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:08:27.600359 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:08:28.154450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:08:28.209770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.222522 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:08:28.284138 tst mo_mt_call.py: using LAC 25566 03:08:28.412162 tst mo_mt_call.py: using RAC 66 03:08:28.539205 tst mo_mt_call.py: using CellId 25566 03:08:28.666555 tst mo_mt_call.py: using BVCI 25567 03:08:28.786563 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.799324 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.812101 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.824810 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.838577 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:28.851108 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:28.975551 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:29.100636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:29.618682 run create_hlr_db(pid=18034): Launched 03:08:29.787728 bus /sierra_2: Setting Powered False 03:08:30.868456 run create_hlr_db(pid=18034): Terminated: ok {rc=0} 03:08:31.383374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Launched 03:08:31.737717 run osmo-hlr_10.42.42.2(pid=18037): Launched 03:08:31.964536 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:32.816023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Launched 03:08:33.201745 run osmo-stp_10.42.42.5(pid=18040): Launched 03:08:33.432540 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:34.157892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Launched 03:08:34.476345 run osmo-msc_10.42.42.6(pid=18043): Launched 03:08:34.824515 run osmo-stp_10.42.42.5(pid=18040): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] 03:08:35.097606 run osmo-stp_10.42.42.5(pid=18040): stdout: | (launched: 2022-12-10_03:08:33.122723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:35.367173 run osmo-stp_10.42.42.5(pid=18040): stderr: | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030833467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:35.553331 run osmo-stp_10.42.42.5(pid=18040): stdout: | (launched: 2022-12-10_03:08:33.122723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:35.676562 run osmo-stp_10.42.42.5(pid=18040): stderr: | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030833466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030833467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030833467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:35.823936 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18040): Process ended prematurely: osmo-stp_10.42.42.5(pid=18040) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:08:35.833828 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 03:08:35.863843 run osmo-hlr_10.42.42.2(pid=18037): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18037)] 03:08:35.914566 run osmo-hlr_10.42.42.2(pid=18037): stdout: | (launched: 2022-12-10_03:08:31.665611) 03:08:35.967142 run osmo-hlr_10.42.42.2(pid=18037): stderr: | [0;m[1;31m20221210030832039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030832039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030832039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030832044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030832044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030832044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030832058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030832073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030832073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030832073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:36.039984 run osmo-msc_10.42.42.6(pid=18043): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18043)] 03:08:36.090793 run osmo-msc_10.42.42.6(pid=18043): stdout: | (launched: 2022-12-10_03:08:34.412872) 03:08:36.143096 run osmo-msc_10.42.42.6(pid=18043): stderr: | [0;m[38;5;43m20221210030835012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030835012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90d2081c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030835013 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030835013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030835013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030835013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030835015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030835015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030835015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030835015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:36.195998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Terminating (SIGTERM) 03:08:36.238243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Terminating (SIGTERM) 03:08:36.281135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Terminating (SIGTERM) 03:08:36.325907 --- ParallelTerminationStrategy: PID 18036 died... 03:08:36.346159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18036): Terminated: ok {rc=0} 03:08:36.395506 --- ParallelTerminationStrategy: PID 18039 died... 03:08:36.415410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18039): Terminated: ok {rc=0} 03:08:36.463292 --- ParallelTerminationStrategy: PID 18042 died... 03:08:36.483126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18042): Terminated: ok {rc=0} 03:08:36.572355 bus /sierra_3: Setting Powered False 03:08:37.673372 bus /sierra_3: Setting Powered False 03:08:38.792194 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:08:39.937733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:39.949498 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:08:40.009403 tst mo_mt_call_osmux.py: using LAC 25567 03:08:40.127928 tst mo_mt_call_osmux.py: using RAC 67 03:08:40.245722 tst mo_mt_call_osmux.py: using CellId 25567 03:08:40.375456 tst mo_mt_call_osmux.py: using BVCI 25568 03:08:40.487143 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:40.498363 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:40.509351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:40.520419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:40.531758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:40.542848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:40.659562 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:40.775340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:41.242912 run create_hlr_db(pid=18047): Launched 03:08:41.358539 bus /sierra_2: Setting Powered False 03:08:42.418688 run create_hlr_db(pid=18047): Terminated: ok {rc=0} 03:08:42.859441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18049): Launched 03:08:43.181667 run osmo-hlr_10.42.42.2(pid=18050): Launched 03:08:43.305731 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:43.863653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18052): Launched 03:08:44.185727 run osmo-stp_10.42.42.5(pid=18053): Launched 03:08:44.309139 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:44.892552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18055): Launched 03:08:45.213862 run osmo-msc_10.42.42.6(pid=18056): Launched 03:08:45.393536 run osmo-stp_10.42.42.5(pid=18053): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18053)] 03:08:45.528445 run osmo-stp_10.42.42.5(pid=18053): stdout: | (launched: 2022-12-10_03:08:44.126975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:45.664313 run osmo-stp_10.42.42.5(pid=18053): stderr: | [0;m[38;5;43m20221210030844321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030844321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030844322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030844322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030844322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030844322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030844323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:45.799382 run osmo-stp_10.42.42.5(pid=18053): stdout: | (launched: 2022-12-10_03:08:44.126975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:45.949635 run osmo-stp_10.42.42.5(pid=18053): stderr: | [0;m[38;5;43m20221210030844321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030844321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030844322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030844322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030844322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030844322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030844323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:46.138120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18053): Process ended prematurely: osmo-stp_10.42.42.5(pid=18053) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18053)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:08:46.147912 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:08:46.183691 run osmo-hlr_10.42.42.2(pid=18050): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18050)] 03:08:46.243436 run osmo-hlr_10.42.42.2(pid=18050): stdout: | (launched: 2022-12-10_03:08:43.123109) 03:08:46.307765 run osmo-hlr_10.42.42.2(pid=18050): stderr: | [0;m[1;31m20221210030843322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030843322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030843322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030843322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030843323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030843323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030843334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030843343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030843343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030843343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:46.394712 run osmo-msc_10.42.42.6(pid=18056): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18056)] 03:08:46.452856 run osmo-msc_10.42.42.6(pid=18056): stdout: | (launched: 2022-12-10_03:08:45.155157) 03:08:46.505887 run osmo-msc_10.42.42.6(pid=18056): stderr: | [0;m[38;5;43m20221210030845476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030845476 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6652bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030845476 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030845476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030845476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030845477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030845478 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030845479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030845479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030845479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:46.558789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18049): Terminating (SIGTERM) 03:08:46.607418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18052): Terminating (SIGTERM) 03:08:46.657897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18055): Terminating (SIGTERM) 03:08:46.714969 --- ParallelTerminationStrategy: PID 18049 died... 03:08:46.735816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18049): Terminated: ok {rc=0} 03:08:46.788149 --- ParallelTerminationStrategy: PID 18052 died... 03:08:46.811741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18052): Terminated: ok {rc=0} 03:08:46.865556 --- ParallelTerminationStrategy: PID 18055 died... 03:08:46.886203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18055): Terminated: ok {rc=0} 03:08:46.976892 bus /sierra_3: Setting Powered False 03:08:48.075089 bus /sierra_3: Setting Powered False 03:08:49.187731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:08:50.431506 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:50.439327 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:08:50.463504 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:08:50.490830 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:08:50.543436 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:08:50.566856 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:08:50.593922 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:08:51.143850 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:08:51.192764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.204039 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:08:51.262806 tst mo_mt_call.py: using LAC 25568 03:08:51.382263 tst mo_mt_call.py: using RAC 68 03:08:51.507716 tst mo_mt_call.py: using CellId 25568 03:08:51.632519 tst mo_mt_call.py: using BVCI 25569 03:08:51.750140 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.761758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.773150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.784592 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.796090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:51.807536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:08:51.925871 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:08:52.041690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:52.507522 run create_hlr_db(pid=18061): Launched 03:08:52.624275 bus /sierra_2: Setting Powered False 03:08:53.684517 run create_hlr_db(pid=18061): Terminated: ok {rc=0} 03:08:54.123616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18063): Launched 03:08:54.445380 run osmo-hlr_10.42.42.2(pid=18064): Launched 03:08:54.569248 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:55.124524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18066): Launched 03:08:55.445608 run osmo-stp_10.42.42.5(pid=18067): Launched 03:08:55.568894 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:56.150710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18069): Launched 03:08:56.472090 run osmo-msc_10.42.42.6(pid=18070): Launched 03:08:56.651975 run osmo-stp_10.42.42.5(pid=18067): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18067)] 03:08:56.788367 run osmo-stp_10.42.42.5(pid=18067): stdout: | (launched: 2022-12-10_03:08:55.386503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:56.925319 run osmo-stp_10.42.42.5(pid=18067): stderr: | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030855582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:57.061199 run osmo-stp_10.42.42.5(pid=18067): stdout: | (launched: 2022-12-10_03:08:55.386503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:57.188836 run osmo-stp_10.42.42.5(pid=18067): stderr: | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030855581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030855582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030855582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:57.341786 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18067): Process ended prematurely: osmo-stp_10.42.42.5(pid=18067) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18067)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:08:57.351314 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:08:57.379022 run osmo-hlr_10.42.42.2(pid=18064): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18064)] 03:08:57.428782 run osmo-hlr_10.42.42.2(pid=18064): stdout: | (launched: 2022-12-10_03:08:54.386753) 03:08:57.480421 run osmo-hlr_10.42.42.2(pid=18064): stderr: | [0;m[1;31m20221210030854586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030854586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030854586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030854587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030854587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030854587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030854599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030854607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030854607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030854607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:57.552475 run osmo-msc_10.42.42.6(pid=18070): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18070)] 03:08:57.602045 run osmo-msc_10.42.42.6(pid=18070): stdout: | (launched: 2022-12-10_03:08:56.413522) 03:08:57.653368 run osmo-msc_10.42.42.6(pid=18070): stderr: | [0;m[38;5;43m20221210030856736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030856736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e30458c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030856737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030856737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030856737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030856737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030856739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030856739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030856739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030856739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:57.705112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18063): Terminating (SIGTERM) 03:08:57.746473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18066): Terminating (SIGTERM) 03:08:57.787930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18069): Terminating (SIGTERM) 03:08:57.829910 --- ParallelTerminationStrategy: PID 18063 died... 03:08:57.850255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18063): Terminated: ok {rc=0} 03:08:57.896549 --- ParallelTerminationStrategy: PID 18066 died... 03:08:57.916150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18066): Terminated: ok {rc=0} 03:08:57.962113 --- ParallelTerminationStrategy: PID 18069 died... 03:08:57.981721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18069): Terminated: ok {rc=0} 03:08:58.069016 bus /sierra_3: Setting Powered False 03:08:59.167409 bus /sierra_3: Setting Powered False 03:09:00.283416 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:09:01.430335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:01.442956 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:09:01.508104 tst mo_mt_call_osmux.py: using LAC 25569 03:09:01.631184 tst mo_mt_call_osmux.py: using RAC 69 03:09:01.753190 tst mo_mt_call_osmux.py: using CellId 25569 03:09:01.914399 tst mo_mt_call_osmux.py: using BVCI 25570 03:09:02.032004 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:02.044463 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:02.057567 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:02.069509 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:02.082197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:02.095521 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:02.221958 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:02.343862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:02.811368 run create_hlr_db(pid=18072): Launched 03:09:02.926685 bus /sierra_2: Setting Powered False 03:09:03.985970 run create_hlr_db(pid=18072): Terminated: ok {rc=0} 03:09:04.404379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Launched 03:09:04.706063 run osmo-hlr_10.42.42.2(pid=18075): Launched 03:09:04.820805 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:05.352283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Launched 03:09:05.653857 run osmo-stp_10.42.42.5(pid=18078): Launched 03:09:05.768535 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:06.312076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Launched 03:09:06.613676 run osmo-msc_10.42.42.6(pid=18081): Launched 03:09:06.783471 run osmo-stp_10.42.42.5(pid=18078): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] 03:09:06.911601 run osmo-stp_10.42.42.5(pid=18078): stdout: | (launched: 2022-12-10_03:09:05.598791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:07.039940 run osmo-stp_10.42.42.5(pid=18078): stderr: | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030905771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:07.165658 run osmo-stp_10.42.42.5(pid=18078): stdout: | (launched: 2022-12-10_03:09:05.598791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:07.285401 run osmo-stp_10.42.42.5(pid=18078): stderr: | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030905770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030905771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030905771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:07.428279 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18078): Process ended prematurely: osmo-stp_10.42.42.5(pid=18078) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:09:07.437287 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:09:07.464021 run osmo-hlr_10.42.42.2(pid=18075): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18075)] 03:09:07.512213 run osmo-hlr_10.42.42.2(pid=18075): stdout: | (launched: 2022-12-10_03:09:04.650931) 03:09:07.562029 run osmo-hlr_10.42.42.2(pid=18075): stderr: | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030904828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030904839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030904849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030904849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030904849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:07.631070 run osmo-msc_10.42.42.6(pid=18081): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18081)] 03:09:07.678825 run osmo-msc_10.42.42.6(pid=18081): stdout: | (launched: 2022-12-10_03:09:06.558406) 03:09:07.728341 run osmo-msc_10.42.42.6(pid=18081): stderr: | [0;m[38;5;43m20221210030906830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030906831 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb25ee1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030906831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030906831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030906831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030906831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030906833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030906833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030906833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030906833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:07.778330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Terminating (SIGTERM) 03:09:07.818317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Terminating (SIGTERM) 03:09:07.857887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Terminating (SIGTERM) 03:09:07.897824 --- ParallelTerminationStrategy: PID 18074 died... 03:09:07.916902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18074): Terminated: ok {rc=0} 03:09:07.961233 --- ParallelTerminationStrategy: PID 18077 died... 03:09:07.979871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18077): Terminated: ok {rc=0} 03:09:08.023888 --- ParallelTerminationStrategy: PID 18080 died... 03:09:08.042532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18080): Terminated: ok {rc=0} 03:09:08.128513 bus /sierra_3: Setting Powered False 03:09:09.226946 bus /sierra_3: Setting Powered False 03:09:10.342703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:09:11.584192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:11.591985 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:09:11.616143 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:09:11.643197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:09:11.694858 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:09:11.719272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:09:11.746453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:09:12.300365 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:09:12.351455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.362973 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:12.423625 tst mo_mt_call.py: using LAC 25570 03:09:12.549765 tst mo_mt_call.py: using RAC 70 03:09:12.668652 tst mo_mt_call.py: using CellId 25570 03:09:12.787413 tst mo_mt_call.py: using BVCI 25571 03:09:12.899251 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.910561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.921778 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.932895 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.944522 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:12.955745 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:13.073403 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:13.193522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:13.691845 run create_hlr_db(pid=18087): Launched 03:09:13.823818 bus /sierra_2: Setting Powered False 03:09:14.888240 run create_hlr_db(pid=18087): Terminated: ok {rc=0} 03:09:15.317124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18089): Launched 03:09:15.618362 run osmo-hlr_10.42.42.2(pid=18090): Launched 03:09:15.734817 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:16.332601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18092): Launched 03:09:16.657864 run osmo-stp_10.42.42.5(pid=18093): Launched 03:09:16.892012 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:17.510331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18095): Launched 03:09:17.816677 run osmo-msc_10.42.42.6(pid=18096): Launched 03:09:17.998452 run osmo-stp_10.42.42.5(pid=18093): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18093)] 03:09:18.135491 run osmo-stp_10.42.42.5(pid=18093): stdout: | (launched: 2022-12-10_03:09:16.591622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:18.272055 run osmo-stp_10.42.42.5(pid=18093): stderr: | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030916928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:18.408054 run osmo-stp_10.42.42.5(pid=18093): stdout: | (launched: 2022-12-10_03:09:16.591622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:18.535574 run osmo-stp_10.42.42.5(pid=18093): stderr: | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030916928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030916928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030916936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:18.688394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18093): Process ended prematurely: osmo-stp_10.42.42.5(pid=18093) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18093)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:09:18.697661 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:09:18.725107 run osmo-hlr_10.42.42.2(pid=18090): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18090)] 03:09:18.774570 run osmo-hlr_10.42.42.2(pid=18090): stdout: | (launched: 2022-12-10_03:09:15.563221) 03:09:18.825696 run osmo-hlr_10.42.42.2(pid=18090): stderr: | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030915740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030915752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030915761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030915761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030915761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:18.897588 run osmo-msc_10.42.42.6(pid=18096): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18096)] 03:09:18.947459 run osmo-msc_10.42.42.6(pid=18096): stdout: | (launched: 2022-12-10_03:09:17.756278) 03:09:18.998722 run osmo-msc_10.42.42.6(pid=18096): stderr: | [0;m[38;5;43m20221210030918077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030918078 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d57ae3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030918078 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030918078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030918078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030918078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030918080 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030918080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030918080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030918080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:19.050262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18089): Terminating (SIGTERM) 03:09:19.091410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18092): Terminating (SIGTERM) 03:09:19.132632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18095): Terminating (SIGTERM) 03:09:19.174165 --- ParallelTerminationStrategy: PID 18089 died... 03:09:19.193935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18089): Terminated: ok {rc=0} 03:09:19.239605 --- ParallelTerminationStrategy: PID 18092 died... 03:09:19.259017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18092): Terminated: ok {rc=0} 03:09:19.305129 --- ParallelTerminationStrategy: PID 18095 died... 03:09:19.324283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18095): Terminated: ok {rc=0} 03:09:19.411054 bus /sierra_3: Setting Powered False 03:09:20.509759 bus /sierra_3: Setting Powered False 03:09:21.626083 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:09:22.769829 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:22.781617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:22.841429 tst mo_mt_call_osmux.py: using LAC 25571 03:09:22.970915 tst mo_mt_call_osmux.py: using RAC 71 03:09:23.098457 tst mo_mt_call_osmux.py: using CellId 25571 03:09:23.220532 tst mo_mt_call_osmux.py: using BVCI 25572 03:09:23.331336 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:23.342651 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:23.353947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:23.365181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:23.376359 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:23.387810 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:23.506874 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:23.627736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:24.126127 run create_hlr_db(pid=18098): Launched 03:09:24.257892 bus /sierra_2: Setting Powered False 03:09:25.321994 run create_hlr_db(pid=18098): Terminated: ok {rc=0} 03:09:25.751139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Launched 03:09:26.052202 run osmo-hlr_10.42.42.2(pid=18101): Launched 03:09:26.168108 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:26.704287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Launched 03:09:27.006275 run osmo-stp_10.42.42.5(pid=18104): Launched 03:09:27.121160 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:27.669824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18106): Launched 03:09:27.973217 run osmo-msc_10.42.42.6(pid=18107): Launched 03:09:28.144092 run osmo-stp_10.42.42.5(pid=18104): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] 03:09:28.273299 run osmo-stp_10.42.42.5(pid=18104): stdout: | (launched: 2022-12-10_03:09:26.950463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:28.402453 run osmo-stp_10.42.42.5(pid=18104): stderr: | [0;m[38;5;43m20221210030927121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030927122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030927122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030927122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:28.528852 run osmo-stp_10.42.42.5(pid=18104): stdout: | (launched: 2022-12-10_03:09:26.950463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:28.649166 run osmo-stp_10.42.42.5(pid=18104): stderr: | [0;m[38;5;43m20221210030927121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030927122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030927122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030927122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030927123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:28.792863 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18104): Process ended prematurely: osmo-stp_10.42.42.5(pid=18104) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:09:28.801809 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:09:28.828537 run osmo-hlr_10.42.42.2(pid=18101): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18101)] 03:09:28.875990 run osmo-hlr_10.42.42.2(pid=18101): stdout: | (launched: 2022-12-10_03:09:25.996749) 03:09:28.925257 run osmo-hlr_10.42.42.2(pid=18101): stderr: | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030926171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030926183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030926192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030926192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030926192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:28.993897 run osmo-msc_10.42.42.6(pid=18107): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18107)] 03:09:29.041625 run osmo-msc_10.42.42.6(pid=18107): stdout: | (launched: 2022-12-10_03:09:27.917711) 03:09:29.090789 run osmo-msc_10.42.42.6(pid=18107): stderr: | [0;m[38;5;43m20221210030928188 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030928189 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a9e42ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030928189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030928189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030928189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030928189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030928191 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030928191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030928191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030928191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:29.140473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Terminating (SIGTERM) 03:09:29.180141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Terminating (SIGTERM) 03:09:29.219887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18106): Terminating (SIGTERM) 03:09:29.259873 --- ParallelTerminationStrategy: PID 18100 died... 03:09:29.278876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Terminated: ok {rc=0} 03:09:29.323008 --- ParallelTerminationStrategy: PID 18103 died... 03:09:29.341663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Terminated: ok {rc=0} 03:09:29.385876 --- ParallelTerminationStrategy: PID 18106 died... 03:09:29.404416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18106): Terminated: ok {rc=0} 03:09:29.488407 bus /sierra_3: Setting Powered False 03:09:30.586382 bus /sierra_3: Setting Powered False 03:09:31.720850 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:09:32.975187 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:32.982976 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:09:33.007378 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:09:33.034724 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:09:33.087170 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:09:33.111277 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:09:33.138218 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:09:33.691951 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:09:33.743335 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:33.754944 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:09:33.815640 tst mo_mt_call.py: using LAC 25572 03:09:33.941482 tst mo_mt_call.py: using RAC 72 03:09:34.066852 tst mo_mt_call.py: using CellId 25572 03:09:34.196751 tst mo_mt_call.py: using BVCI 25573 03:09:34.314577 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:34.326151 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:34.337550 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:34.349049 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:34.360526 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:34.371898 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:34.486467 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:34.606906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:35.104801 run create_hlr_db(pid=18113): Launched 03:09:35.235365 bus /sierra_2: Setting Powered False 03:09:36.298239 run create_hlr_db(pid=18113): Terminated: ok {rc=0} 03:09:36.725329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18115): Launched 03:09:37.025677 run osmo-hlr_10.42.42.2(pid=18116): Launched 03:09:37.141278 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:37.657744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18118): Launched 03:09:37.958156 run osmo-stp_10.42.42.5(pid=18119): Launched 03:09:38.072264 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:38.613592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18121): Launched 03:09:38.914761 run osmo-msc_10.42.42.6(pid=18122): Launched 03:09:39.082289 run osmo-stp_10.42.42.5(pid=18119): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18119)] 03:09:39.209477 run osmo-stp_10.42.42.5(pid=18119): stdout: | (launched: 2022-12-10_03:09:37.903109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:39.336872 run osmo-stp_10.42.42.5(pid=18119): stderr: | [0;m[38;5;43m20221210030938071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030938071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030938072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030938072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030938072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030938073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030938073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:39.461983 run osmo-stp_10.42.42.5(pid=18119): stdout: | (launched: 2022-12-10_03:09:37.903109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:39.580715 run osmo-stp_10.42.42.5(pid=18119): stderr: | [0;m[38;5;43m20221210030938071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030938071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030938072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030938072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030938072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030938073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030938073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:39.722631 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18119): Process ended prematurely: osmo-stp_10.42.42.5(pid=18119) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18119)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:09:39.731324 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:09:39.757886 run osmo-hlr_10.42.42.2(pid=18116): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18116)] 03:09:39.805280 run osmo-hlr_10.42.42.2(pid=18116): stdout: | (launched: 2022-12-10_03:09:36.970555) 03:09:39.854613 run osmo-hlr_10.42.42.2(pid=18116): stderr: | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030937148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030937160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030937169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030937169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030937169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:39.923382 run osmo-msc_10.42.42.6(pid=18122): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18122)] 03:09:39.970799 run osmo-msc_10.42.42.6(pid=18122): stdout: | (launched: 2022-12-10_03:09:38.859136) 03:09:40.019750 run osmo-msc_10.42.42.6(pid=18122): stderr: | [0;m[38;5;43m20221210030939130 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030939130 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f0ae2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030939131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030939131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030939131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030939131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030939133 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030939134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030939134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030939134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:40.069324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18115): Terminating (SIGTERM) 03:09:40.109178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18118): Terminating (SIGTERM) 03:09:40.148441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18121): Terminating (SIGTERM) 03:09:40.188198 --- ParallelTerminationStrategy: PID 18115 died... 03:09:40.207121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18115): Terminated: ok {rc=0} 03:09:40.251200 --- ParallelTerminationStrategy: PID 18118 died... 03:09:40.269742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18118): Terminated: ok {rc=0} 03:09:40.313552 --- ParallelTerminationStrategy: PID 18121 died... 03:09:40.332066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18121): Terminated: ok {rc=0} 03:09:40.415918 bus /sierra_3: Setting Powered False 03:09:41.513620 bus /sierra_3: Setting Powered False 03:09:42.631338 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:09:43.780144 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:43.792242 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:09:43.853347 tst mo_mt_call_osmux.py: using LAC 25573 03:09:43.980333 tst mo_mt_call_osmux.py: using RAC 73 03:09:44.106322 tst mo_mt_call_osmux.py: using CellId 25573 03:09:44.234097 tst mo_mt_call_osmux.py: using BVCI 25574 03:09:44.352374 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:44.363960 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:44.375395 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:44.387043 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:44.398584 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:44.409967 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:44.530185 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:44.649576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:45.152276 run create_hlr_db(pid=18125): Launched 03:09:45.283186 bus /sierra_2: Setting Powered False 03:09:46.366804 run create_hlr_db(pid=18125): Terminated: ok {rc=0} 03:09:46.925683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Launched 03:09:47.257660 run osmo-hlr_10.42.42.2(pid=18128): Launched 03:09:47.383022 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:47.913445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Launched 03:09:48.215087 run osmo-stp_10.42.42.5(pid=18131): Launched 03:09:48.329781 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:48.873121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18133): Launched 03:09:49.174224 run osmo-msc_10.42.42.6(pid=18134): Launched 03:09:49.343029 run osmo-stp_10.42.42.5(pid=18131): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] 03:09:49.471248 run osmo-stp_10.42.42.5(pid=18131): stdout: | (launched: 2022-12-10_03:09:48.159112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:49.599451 run osmo-stp_10.42.42.5(pid=18131): stderr: | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030948331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:49.724871 run osmo-stp_10.42.42.5(pid=18131): stdout: | (launched: 2022-12-10_03:09:48.159112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:49.843824 run osmo-stp_10.42.42.5(pid=18131): stderr: | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030948330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030948331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030948331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:49.986484 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18131): Process ended prematurely: osmo-stp_10.42.42.5(pid=18131) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:09:49.995260 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:09:50.021735 run osmo-hlr_10.42.42.2(pid=18128): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18128)] 03:09:50.069486 run osmo-hlr_10.42.42.2(pid=18128): stdout: | (launched: 2022-12-10_03:09:47.191307) 03:09:50.118904 run osmo-hlr_10.42.42.2(pid=18128): stderr: | [0;m[1;31m20221210030947375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030947375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030947375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030947375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030947375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030947376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030947391 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030947401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030947401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030947401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:50.187617 run osmo-msc_10.42.42.6(pid=18134): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18134)] 03:09:50.235773 run osmo-msc_10.42.42.6(pid=18134): stdout: | (launched: 2022-12-10_03:09:49.118570) 03:09:50.285036 run osmo-msc_10.42.42.6(pid=18134): stderr: | [0;m[38;5;43m20221210030949388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210030949388 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f881da4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210030949388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210030949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210030949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210030949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210030949390 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210030949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210030949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210030949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:50.334390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Terminating (SIGTERM) 03:09:50.373621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Terminating (SIGTERM) 03:09:50.412840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18133): Terminating (SIGTERM) 03:09:50.452553 --- ParallelTerminationStrategy: PID 18127 died... 03:09:50.471495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18127): Terminated: ok {rc=0} 03:09:50.515818 --- ParallelTerminationStrategy: PID 18130 died... 03:09:50.534208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18130): Terminated: ok {rc=0} 03:09:50.577860 --- ParallelTerminationStrategy: PID 18133 died... 03:09:50.596253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18133): Terminated: ok {rc=0} 03:09:50.681975 bus /sierra_3: Setting Powered False 03:09:51.781607 bus /sierra_3: Setting Powered False 03:09:52.895345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:09:54.132090 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:54.139231 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:09:54.163710 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:09:54.190551 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:09:54.242497 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:09:54.266492 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:09:54.293414 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:09:54.844158 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:09:54.892221 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:54.903389 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:09:54.962963 tst mo_mt_call.py: using LAC 25574 03:09:55.085295 tst mo_mt_call.py: using RAC 74 03:09:55.211350 tst mo_mt_call.py: using CellId 25574 03:09:55.336605 tst mo_mt_call.py: using BVCI 25575 03:09:55.453912 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:55.465875 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:55.477677 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:55.489867 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:55.501871 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:09:55.513654 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:09:55.628837 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:09:55.748693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:56.247741 run create_hlr_db(pid=18139): Launched 03:09:56.379224 bus /sierra_2: Setting Powered False 03:09:57.442239 run create_hlr_db(pid=18139): Terminated: ok {rc=0} 03:09:57.871724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18141): Launched 03:09:58.174372 run osmo-hlr_10.42.42.2(pid=18142): Launched 03:09:58.289446 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:58.820451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18144): Launched 03:09:59.121744 run osmo-stp_10.42.42.5(pid=18145): Launched 03:09:59.236181 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:59.782572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18147): Launched 03:10:00.084827 run osmo-msc_10.42.42.6(pid=18148): Launched 03:10:00.253698 run osmo-stp_10.42.42.5(pid=18145): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18145)] 03:10:00.381814 run osmo-stp_10.42.42.5(pid=18145): stdout: | (launched: 2022-12-10_03:09:59.066384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:00.510459 run osmo-stp_10.42.42.5(pid=18145): stderr: | [0;m[38;5;43m20221210030959235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030959235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030959236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030959236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:00.636285 run osmo-stp_10.42.42.5(pid=18145): stdout: | (launched: 2022-12-10_03:09:59.066384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:00.755498 run osmo-stp_10.42.42.5(pid=18145): stderr: | [0;m[38;5;43m20221210030959235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210030959235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210030959236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210030959236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210030959237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:00.906991 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18145): Process ended prematurely: osmo-stp_10.42.42.5(pid=18145) [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18145)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:10:00.916507 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:10:00.944087 run osmo-hlr_10.42.42.2(pid=18142): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18142)] 03:10:00.992753 run osmo-hlr_10.42.42.2(pid=18142): stdout: | (launched: 2022-12-10_03:09:58.118672) 03:10:01.043262 run osmo-hlr_10.42.42.2(pid=18142): stderr: | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210030958293 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210030958305 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210030958314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210030958314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210030958314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:01.113546 run osmo-msc_10.42.42.6(pid=18148): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18148)] 03:10:01.162433 run osmo-msc_10.42.42.6(pid=18148): stdout: | (launched: 2022-12-10_03:10:00.028882) 03:10:01.213219 run osmo-msc_10.42.42.6(pid=18148): stderr: | [0;m[38;5;43m20221210031000302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031000302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1063e6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031000302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031000302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031000302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031000302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031000304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031000304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031000305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031000305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:01.264796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18141): Terminating (SIGTERM) 03:10:01.307130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18144): Terminating (SIGTERM) 03:10:01.350761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18147): Terminating (SIGTERM) 03:10:01.394311 --- ParallelTerminationStrategy: PID 18141 died... 03:10:01.414121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18141): Terminated: ok {rc=0} 03:10:01.460732 --- ParallelTerminationStrategy: PID 18144 died... 03:10:01.480260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18144): Terminated: ok {rc=0} 03:10:01.527061 --- ParallelTerminationStrategy: PID 18147 died... 03:10:01.546798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18147): Terminated: ok {rc=0} 03:10:01.639373 bus /sierra_3: Setting Powered False 03:10:02.745305 bus /sierra_3: Setting Powered False 03:10:03.860139 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:10:05.005685 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.017449 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:10:05.077427 tst mo_mt_call_osmux.py: using LAC 25575 03:10:05.197364 tst mo_mt_call_osmux.py: using RAC 75 03:10:05.316456 tst mo_mt_call_osmux.py: using CellId 25575 03:10:05.444299 tst mo_mt_call_osmux.py: using BVCI 25576 03:10:05.561345 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.573149 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.584800 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.596495 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.608319 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:05.620621 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:05.740360 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:05.857907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:06.324765 run create_hlr_db(pid=18153): Launched 03:10:06.441093 bus /sierra_2: Setting Powered False 03:10:07.502938 run create_hlr_db(pid=18153): Terminated: ok {rc=0} 03:10:07.942562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18155): Launched 03:10:08.265509 run osmo-hlr_10.42.42.2(pid=18156): Launched 03:10:08.388834 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:08.949434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18158): Launched 03:10:09.272250 run osmo-stp_10.42.42.5(pid=18159): Launched 03:10:09.396790 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:09.978609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18161): Launched 03:10:10.300720 run osmo-msc_10.42.42.6(pid=18162): Launched 03:10:10.480300 run osmo-stp_10.42.42.5(pid=18159): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18159)] 03:10:10.616066 run osmo-stp_10.42.42.5(pid=18159): stdout: | (launched: 2022-12-10_03:10:09.213453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:10.754309 run osmo-stp_10.42.42.5(pid=18159): stderr: | [0;m[38;5;43m20221210031009408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031009408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031009409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031009409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031009409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031009410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031009410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:10.890293 run osmo-stp_10.42.42.5(pid=18159): stdout: | (launched: 2022-12-10_03:10:09.213453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:11.018073 run osmo-stp_10.42.42.5(pid=18159): stderr: | [0;m[38;5;43m20221210031009408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031009408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031009409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031009409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031009409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031009410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031009410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:11.170965 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18159): Process ended prematurely: osmo-stp_10.42.42.5(pid=18159) [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18159)] [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:10:11.180271 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:10:11.208212 run osmo-hlr_10.42.42.2(pid=18156): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18156)] 03:10:11.257844 run osmo-hlr_10.42.42.2(pid=18156): stdout: | (launched: 2022-12-10_03:10:08.206664) 03:10:11.309521 run osmo-hlr_10.42.42.2(pid=18156): stderr: | [0;m[1;31m20221210031008405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031008405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031008405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031008405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031008405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031008406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031008418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031008426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031008426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031008426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:11.382000 run osmo-msc_10.42.42.6(pid=18162): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18162)] 03:10:11.431539 run osmo-msc_10.42.42.6(pid=18162): stdout: | (launched: 2022-12-10_03:10:10.241855) 03:10:11.482709 run osmo-msc_10.42.42.6(pid=18162): stderr: | [0;m[38;5;43m20221210031010564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031010565 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6678cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031010565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031010565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031010565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031010565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031010567 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031010567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031010567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031010567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:11.534413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18155): Terminating (SIGTERM) 03:10:11.575881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18158): Terminating (SIGTERM) 03:10:11.617484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18161): Terminating (SIGTERM) 03:10:11.659285 --- ParallelTerminationStrategy: PID 18155 died... 03:10:11.678979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18155): Terminated: ok {rc=0} 03:10:11.724903 --- ParallelTerminationStrategy: PID 18158 died... 03:10:11.744336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18158): Terminated: ok {rc=0} 03:10:11.790368 --- ParallelTerminationStrategy: PID 18161 died... 03:10:11.809954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18161): Terminated: ok {rc=0} 03:10:11.897802 bus /sierra_3: Setting Powered False 03:10:12.996074 bus /sierra_3: Setting Powered False 03:10:14.111727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:nanobts+band-1900 --------------------------------------------------------------------- 03:10:15.351785 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:15.356806 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:10:15.380827 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:10:15.408033 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:10:15.492085 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:10:15.516538 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:10:15.543719 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:10:16.150433 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 03:10:16.158843 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.173822 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:16.225504 tst emergency_mo_mt_call.py: using LAC 25576 03:10:16.384816 tst emergency_mo_mt_call.py: using RAC 76 03:10:16.503745 tst emergency_mo_mt_call.py: using CellId 25576 03:10:16.626756 tst emergency_mo_mt_call.py: using BVCI 25577 03:10:16.738378 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.750102 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.761900 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.774554 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.788117 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:16.799708 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:16.918201 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:17.036085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:17.498937 run create_hlr_db(pid=18167): Launched 03:10:17.613122 bus /sierra_2: Setting Powered False 03:10:18.672083 run create_hlr_db(pid=18167): Terminated: ok {rc=0} 03:10:19.083815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18169): Launched 03:10:19.378196 run osmo-hlr_10.42.42.2(pid=18170): Launched 03:10:19.491064 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:20.011336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18172): Launched 03:10:20.306478 run osmo-stp_10.42.42.5(pid=18173): Launched 03:10:20.427326 tst emergency_mo_mt_call.py: using MSISDN 7516 03:10:20.578279 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:21.109679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18175): Launched 03:10:21.405132 run osmo-msc_10.42.42.6(pid=18176): Launched 03:10:21.571835 run osmo-stp_10.42.42.5(pid=18173): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18173)] 03:10:21.698325 run osmo-stp_10.42.42.5(pid=18173): stdout: | (launched: 2022-12-10_03:10:20.252005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:21.825070 run osmo-stp_10.42.42.5(pid=18173): stderr: | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031020422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031020422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031020422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031020423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:21.948652 run osmo-stp_10.42.42.5(pid=18173): stdout: | (launched: 2022-12-10_03:10:20.252005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:22.066126 run osmo-stp_10.42.42.5(pid=18173): stderr: | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031020421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031020422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031020422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031020422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031020423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:22.206704 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18173): Process ended prematurely: osmo-stp_10.42.42.5(pid=18173) [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18173)] [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 03:10:22.214799 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 03:10:22.241090 run osmo-hlr_10.42.42.2(pid=18170): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18170)] 03:10:22.288545 run osmo-hlr_10.42.42.2(pid=18170): stdout: | (launched: 2022-12-10_03:10:19.324132) 03:10:22.337717 run osmo-hlr_10.42.42.2(pid=18170): stderr: | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031019499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031019515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031019525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031019525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031019525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:22.406383 run osmo-msc_10.42.42.6(pid=18176): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18176)] 03:10:22.454006 run osmo-msc_10.42.42.6(pid=18176): stdout: | (launched: 2022-12-10_03:10:21.350662) 03:10:22.503012 run osmo-msc_10.42.42.6(pid=18176): stderr: | [0;m[38;5;43m20221210031021620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031021621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cf606cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031021621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031021621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031021621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031021621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031021625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031021626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031021626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031021626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:22.552252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18169): Terminating (SIGTERM) 03:10:22.591646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18172): Terminating (SIGTERM) 03:10:22.631255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18175): Terminating (SIGTERM) 03:10:22.670959 --- ParallelTerminationStrategy: PID 18169 died... 03:10:22.690033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18169): Terminated: ok {rc=0} 03:10:22.733945 --- ParallelTerminationStrategy: PID 18172 died... 03:10:22.752406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18172): Terminated: ok {rc=0} 03:10:22.796641 --- ParallelTerminationStrategy: PID 18175 died... 03:10:22.815173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18175): Terminated: ok {rc=0} 03:10:22.902770 bus /sierra_3: Setting Powered False 03:10:24.001497 bus /sierra_3: Setting Powered False 03:10:25.115799 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 03:10:26.202434 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.213777 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:26.255277 tst emergency_preemptive_call.py: using LAC 25577 03:10:26.372832 tst emergency_preemptive_call.py: using RAC 77 03:10:26.491301 tst emergency_preemptive_call.py: using CellId 25577 03:10:26.606927 tst emergency_preemptive_call.py: using BVCI 25578 03:10:26.713752 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.724365 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.735241 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.746180 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.757012 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:26.767877 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:26.884252 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:27.002609 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:27.118673 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:27.236636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:27.696470 run create_hlr_db(pid=18178): Launched 03:10:27.809208 bus /sierra_2: Setting Powered False 03:10:28.867788 run create_hlr_db(pid=18178): Terminated: ok {rc=0} 03:10:29.301198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Launched 03:10:29.619648 run osmo-hlr_10.42.42.2(pid=18181): Launched 03:10:29.741232 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:30.290660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Launched 03:10:30.606675 run osmo-stp_10.42.42.5(pid=18184): Launched 03:10:30.738026 tst emergency_preemptive_call.py: using MSISDN 7517 03:10:30.942313 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:31.497992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Launched 03:10:31.814513 run osmo-msc_10.42.42.6(pid=18187): Launched 03:10:32.155844 run osmo-stp_10.42.42.5(pid=18184): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] 03:10:32.362385 run osmo-stp_10.42.42.5(pid=18184): stdout: | (launched: 2022-12-10_03:10:30.548690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:32.496317 run osmo-stp_10.42.42.5(pid=18184): stderr: | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031030740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:32.628819 run osmo-stp_10.42.42.5(pid=18184): stdout: | (launched: 2022-12-10_03:10:30.548690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:32.754668 run osmo-stp_10.42.42.5(pid=18184): stderr: | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031030739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031030740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031030740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:32.905561 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18184): Process ended prematurely: osmo-stp_10.42.42.5(pid=18184) [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 03:10:32.914522 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 03:10:32.941926 run osmo-hlr_10.42.42.2(pid=18181): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18181)] 03:10:32.992105 run osmo-hlr_10.42.42.2(pid=18181): stdout: | (launched: 2022-12-10_03:10:29.561935) 03:10:33.043946 run osmo-hlr_10.42.42.2(pid=18181): stderr: | [0;m[1;31m20221210031029757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031029757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031029758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031029758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031029758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031029758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031029769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031029778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031029778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031029778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:33.116025 run osmo-msc_10.42.42.6(pid=18187): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18187)] 03:10:33.166034 run osmo-msc_10.42.42.6(pid=18187): stdout: | (launched: 2022-12-10_03:10:31.753442) 03:10:33.217617 run osmo-msc_10.42.42.6(pid=18187): stderr: | [0;m[38;5;43m20221210031032259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031032260 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d7d2bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031032260 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031032260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031032260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031032260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031032262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031032262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031032263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031032263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:33.269747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Terminating (SIGTERM) 03:10:33.311895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Terminating (SIGTERM) 03:10:33.354007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Terminating (SIGTERM) 03:10:33.395910 --- ParallelTerminationStrategy: PID 18180 died... 03:10:33.416005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Terminated: ok {rc=0} 03:10:33.462489 --- ParallelTerminationStrategy: PID 18183 died... 03:10:33.482234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Terminated: ok {rc=0} 03:10:33.528640 --- ParallelTerminationStrategy: PID 18186 died... 03:10:33.548593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Terminated: ok {rc=0} 03:10:33.636364 bus /sierra_9: Setting Powered False 03:10:34.735820 bus /sierra_9: Setting Powered False 03:10:35.851856 bus /sierra_8: Setting Powered False 03:10:36.950507 bus /sierra_8: Setting Powered False 03:10:38.065907 bus /sierra_3: Setting Powered False 03:10:39.163257 bus /sierra_3: Setting Powered False 03:10:40.281383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900 --------------------------------------------------------------------- 03:10:41.548180 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:41.553218 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:10:41.577094 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 03:10:41.616018 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:10:41.701821 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:10:41.724738 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 03:10:41.762454 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:10:42.353034 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 03:10:42.402114 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.412712 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:42.454367 tst cs_paging_gprs_active.py: using LAC 25578 03:10:42.576352 tst cs_paging_gprs_active.py: using RAC 78 03:10:42.693787 tst cs_paging_gprs_active.py: using CellId 25578 03:10:42.810657 tst cs_paging_gprs_active.py: using BVCI 25579 03:10:42.922091 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.932627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.943027 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.953753 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.964293 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.974908 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.985772 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:42.996181 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:43.006855 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:43.125864 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:43.245693 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:10:43.462487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:10:43.785611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Launched 03:10:44.066242 run iperf3-srv_10.42.42.10(pid=18194): Launched 03:10:44.187496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:10:44.403757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:10:44.726782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18195): Launched 03:10:45.007596 run iperf3-srv_10.42.42.10(pid=18196): Launched 03:10:45.129224 tst cs_paging_gprs_active.py:38: start network... 03:10:45.346206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:45.847018 run create_hlr_db(pid=18197): Launched 03:10:46.016684 bus /sierra_2: Setting Powered False 03:10:47.108190 run create_hlr_db(pid=18197): Terminated: ok {rc=0} 03:10:47.574321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18199): Launched 03:10:47.897620 run osmo-hlr_10.42.42.2(pid=18200): Launched 03:10:48.021044 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:48.577038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18202): Launched 03:10:48.899650 run osmo-stp_10.42.42.5(pid=18203): Launched 03:10:49.023555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:10:49.580918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18205): Launched 03:10:49.705376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:10:49.978575 run patchelf(pid=18206): Launched 03:10:50.158833 run osmo-stp_10.42.42.5(pid=18203): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18203)] 03:10:50.295633 run osmo-stp_10.42.42.5(pid=18203): stdout: | (launched: 2022-12-10_03:10:48.840553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:50.433650 run osmo-stp_10.42.42.5(pid=18203): stderr: | [0;m[38;5;43m20221210031049032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031049033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031049033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031049033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:50.571456 run osmo-stp_10.42.42.5(pid=18203): stdout: | (launched: 2022-12-10_03:10:48.840553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:50.703899 run osmo-stp_10.42.42.5(pid=18203): stderr: | [0;m[38;5;43m20221210031049032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031049033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031049033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031049033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031049034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:50.860426 run patchelf(pid=18206): Terminating (SIGINT) 03:10:51.041769 run patchelf(pid=18206): Terminated: ok {rc=0} 03:10:51.172049 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18203): Process ended prematurely: osmo-stp_10.42.42.5(pid=18203) [trial-2368↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18203)] [trial-2368↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 03:10:51.181954 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:10:51.210223 run osmo-hlr_10.42.42.2(pid=18200): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18200)] 03:10:51.260003 run osmo-hlr_10.42.42.2(pid=18200): stdout: | (launched: 2022-12-10_03:10:47.838422) 03:10:51.311513 run osmo-hlr_10.42.42.2(pid=18200): stderr: | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031048036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031048049 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031048057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031048057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031048057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:51.363432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Terminating (SIGTERM) 03:10:51.404938 run iperf3-srv_10.42.42.10(pid=18194): Terminating (SIGTERM) 03:10:51.446577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18195): Terminating (SIGTERM) 03:10:51.488310 run iperf3-srv_10.42.42.10(pid=18196): Terminating (SIGTERM) 03:10:51.529926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18199): Terminating (SIGTERM) 03:10:51.571678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18202): Terminating (SIGTERM) 03:10:51.613365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18205): Terminating (SIGTERM) 03:10:51.655359 --- ParallelTerminationStrategy: PID 18193 died... 03:10:51.675808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Terminated: ok {rc=0} 03:10:51.722619 --- ParallelTerminationStrategy: PID 18194 died... 03:10:51.742174 run iperf3-srv_10.42.42.10(pid=18194): Terminated {rc=256} 03:10:51.787838 --- ParallelTerminationStrategy: PID 18195 died... 03:10:51.807254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18195): Terminated: ok {rc=0} 03:10:51.853072 --- ParallelTerminationStrategy: PID 18196 died... 03:10:51.872357 run iperf3-srv_10.42.42.10(pid=18196): Terminated {rc=256} 03:10:51.919075 --- ParallelTerminationStrategy: PID 18199 died... 03:10:51.938685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18199): Terminated: ok {rc=0} 03:10:51.984428 --- ParallelTerminationStrategy: PID 18202 died... 03:10:52.003973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18202): Terminated: ok {rc=0} 03:10:52.050402 --- ParallelTerminationStrategy: PID 18205 died... 03:10:52.070154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18205): Terminated: ok {rc=0} 03:10:52.158838 bus /gobi_0: Setting Powered False 03:10:53.259362 bus /gobi_0: Setting Powered False 03:10:54.376039 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 03:10:55.526551 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:55.538243 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:55.580815 tst iperf3.py: using LAC 25579 03:10:55.706595 tst iperf3.py: using RAC 79 03:10:55.831658 tst iperf3.py: using CellId 25579 03:10:55.956770 tst iperf3.py: using BVCI 25580 03:10:56.073480 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.084551 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.095585 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.106481 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.117232 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.127938 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.138926 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.149753 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:56.160674 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:56.278902 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:10:56.479551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:10:56.779664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18207): Launched 03:10:57.042123 run iperf3-srv_10.42.42.10(pid=18208): Launched 03:10:57.155346 tst iperf3.py:8: start network... 03:10:57.355040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:57.820412 run create_hlr_db(pid=18209): Launched 03:10:57.937162 bus /gobi_6: Setting Powered False 03:10:58.997315 run create_hlr_db(pid=18209): Terminated: ok {rc=0} 03:10:59.436380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Launched 03:10:59.758766 run osmo-hlr_10.42.42.2(pid=18212): Launched 03:10:59.882065 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:00.439025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Launched 03:11:00.761591 run osmo-stp_10.42.42.5(pid=18215): Launched 03:11:00.885224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:01.694921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Launched 03:11:01.835287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:02.119060 run patchelf(pid=18218): Launched 03:11:02.312884 run osmo-stp_10.42.42.5(pid=18215): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] 03:11:02.450562 run osmo-stp_10.42.42.5(pid=18215): stdout: | (launched: 2022-12-10_03:11:00.702861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:02.588300 run osmo-stp_10.42.42.5(pid=18215): stderr: | [0;m[38;5;43m20221210031101020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031101026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031101026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031101026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:02.726156 run osmo-stp_10.42.42.5(pid=18215): stdout: | (launched: 2022-12-10_03:11:00.702861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:02.858748 run osmo-stp_10.42.42.5(pid=18215): stderr: | [0;m[38;5;43m20221210031101020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031101026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031101026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031101026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031101027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:03.015945 run patchelf(pid=18218): Terminating (SIGINT) 03:11:03.197263 run patchelf(pid=18218): Terminated: ok {rc=0} 03:11:03.327549 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18215): Process ended prematurely: osmo-stp_10.42.42.5(pid=18215) [trial-2368↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] [trial-2368↪gprs:nanobts+band-1900↪iperf3.py:8] 03:11:03.337647 tst iperf3.py:8: Test FAILED (7.8 sec) 03:11:03.366508 run osmo-hlr_10.42.42.2(pid=18212): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18212)] 03:11:03.417097 run osmo-hlr_10.42.42.2(pid=18212): stdout: | (launched: 2022-12-10_03:10:59.699691) 03:11:03.469453 run osmo-hlr_10.42.42.2(pid=18212): stderr: | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031059898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031059910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031059918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031059919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031059919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:03.522252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18207): Terminating (SIGTERM) 03:11:03.564489 run iperf3-srv_10.42.42.10(pid=18208): Terminating (SIGTERM) 03:11:03.606621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Terminating (SIGTERM) 03:11:03.648834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Terminating (SIGTERM) 03:11:03.691009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Terminating (SIGTERM) 03:11:03.733410 --- ParallelTerminationStrategy: PID 18207 died... 03:11:03.753955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18207): Terminated: ok {rc=0} 03:11:03.801189 --- ParallelTerminationStrategy: PID 18208 died... 03:11:03.821046 run iperf3-srv_10.42.42.10(pid=18208): Terminated {rc=256} 03:11:03.867581 --- ParallelTerminationStrategy: PID 18211 died... 03:11:03.887551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Terminated: ok {rc=0} 03:11:03.934344 --- ParallelTerminationStrategy: PID 18214 died... 03:11:03.954542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Terminated: ok {rc=0} 03:11:04.001290 --- ParallelTerminationStrategy: PID 18217 died... 03:11:04.021219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Terminated: ok {rc=0} 03:11:04.109515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 03:11:05.256510 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.267790 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:05.307281 tst iperf3m4.py: using LAC 25580 03:11:05.426920 tst iperf3m4.py: using RAC 80 03:11:05.546705 tst iperf3m4.py: using CellId 25580 03:11:05.664469 tst iperf3m4.py: using BVCI 25581 03:11:05.774185 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.784780 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.795453 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.806175 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.816841 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.827542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.838393 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.848917 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:05.859843 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:05.975026 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:06.097283 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:06.213339 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:06.329816 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:06.531698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:06.835611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Launched 03:11:07.099240 run iperf3-srv_10.42.42.10(pid=18220): Launched 03:11:07.213312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:11:07.414720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:07.716710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18221): Launched 03:11:07.979906 run iperf3-srv_10.42.42.10(pid=18222): Launched 03:11:08.094195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:11:08.294647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:08.596719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18223): Launched 03:11:08.859815 run iperf3-srv_10.42.42.10(pid=18224): Launched 03:11:08.973358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:11:09.173723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:09.474926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18225): Launched 03:11:09.737912 run iperf3-srv_10.42.42.10(pid=18226): Launched 03:11:09.852332 tst iperf3m4.py:8: start network... 03:11:10.053459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:10.520762 run create_hlr_db(pid=18227): Launched 03:11:10.636377 bus /gobi_6: Setting Powered False 03:11:11.695701 run create_hlr_db(pid=18227): Terminated: ok {rc=0} 03:11:12.118239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18229): Launched 03:11:12.421586 run osmo-hlr_10.42.42.2(pid=18230): Launched 03:11:12.538022 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:13.073573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18232): Launched 03:11:13.376410 run osmo-stp_10.42.42.5(pid=18233): Launched 03:11:13.492149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:14.011301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18235): Launched 03:11:14.126466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:14.380284 run patchelf(pid=18236): Launched 03:11:14.550319 run osmo-stp_10.42.42.5(pid=18233): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18233)] 03:11:14.678087 run osmo-stp_10.42.42.5(pid=18233): stdout: | (launched: 2022-12-10_03:11:13.320793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:14.807020 run osmo-stp_10.42.42.5(pid=18233): stderr: | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031113491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:14.936615 run osmo-stp_10.42.42.5(pid=18233): stdout: | (launched: 2022-12-10_03:11:13.320793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:15.060635 run osmo-stp_10.42.42.5(pid=18233): stderr: | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031113491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031113491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031113492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:15.207846 run patchelf(pid=18236): Terminating (SIGINT) 03:11:15.377635 run patchelf(pid=18236): Terminated: ok {rc=0} 03:11:15.500096 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18233): Process ended prematurely: osmo-stp_10.42.42.5(pid=18233) [trial-2368↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18233)] [trial-2368↪gprs:nanobts+band-1900↪iperf3m4.py:8] 03:11:15.509458 tst iperf3m4.py:8: Test FAILED (10.3 sec) 03:11:15.537467 run osmo-hlr_10.42.42.2(pid=18230): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18230)] 03:11:15.585426 run osmo-hlr_10.42.42.2(pid=18230): stdout: | (launched: 2022-12-10_03:11:12.365808) 03:11:15.635204 run osmo-hlr_10.42.42.2(pid=18230): stderr: | [0;m[1;31m20221210031112544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031112544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031112545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031112545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031112545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031112545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031112556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031112565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031112566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031112566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:15.685845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Terminating (SIGTERM) 03:11:15.725872 run iperf3-srv_10.42.42.10(pid=18220): Terminating (SIGTERM) 03:11:15.765967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18221): Terminating (SIGTERM) 03:11:15.806007 run iperf3-srv_10.42.42.10(pid=18222): Terminating (SIGTERM) 03:11:15.858554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18223): Terminating (SIGTERM) 03:11:15.900504 run iperf3-srv_10.42.42.10(pid=18224): Terminating (SIGTERM) 03:11:15.946718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18225): Terminating (SIGTERM) 03:11:15.995511 run iperf3-srv_10.42.42.10(pid=18226): Terminating (SIGTERM) 03:11:16.046443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18229): Terminating (SIGTERM) 03:11:16.092705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18232): Terminating (SIGTERM) 03:11:16.138392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18235): Terminating (SIGTERM) 03:11:16.184941 --- ParallelTerminationStrategy: PID 18219 died... 03:11:16.206421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18219): Terminated: ok {rc=0} 03:11:16.257057 --- ParallelTerminationStrategy: PID 18220 died... 03:11:16.277540 run iperf3-srv_10.42.42.10(pid=18220): Terminated {rc=256} 03:11:16.326780 --- ParallelTerminationStrategy: PID 18221 died... 03:11:16.347614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18221): Terminated: ok {rc=0} 03:11:16.395986 --- ParallelTerminationStrategy: PID 18222 died... 03:11:16.416916 run iperf3-srv_10.42.42.10(pid=18222): Terminated {rc=256} 03:11:16.466585 --- ParallelTerminationStrategy: PID 18223 died... 03:11:16.488579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18223): Terminated: ok {rc=0} 03:11:16.537491 --- ParallelTerminationStrategy: PID 18224 died... 03:11:16.558261 run iperf3-srv_10.42.42.10(pid=18224): Terminated {rc=256} 03:11:16.606169 --- ParallelTerminationStrategy: PID 18225 died... 03:11:16.626607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18225): Terminated: ok {rc=0} 03:11:16.674590 --- ParallelTerminationStrategy: PID 18226 died... 03:11:16.696578 run iperf3-srv_10.42.42.10(pid=18226): Terminated {rc=256} 03:11:16.744456 --- ParallelTerminationStrategy: PID 18229 died... 03:11:16.764892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18229): Terminated: ok {rc=0} 03:11:16.812607 --- ParallelTerminationStrategy: PID 18232 died... 03:11:16.833062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18232): Terminated: ok {rc=0} 03:11:16.881757 --- ParallelTerminationStrategy: PID 18235 died... 03:11:16.903221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18235): Terminated: ok {rc=0} 03:11:17.000171 bus /gobi_4: Setting Powered False 03:11:18.110060 bus /gobi_4: Setting Powered False 03:11:19.227584 bus /gobi_1: Setting Powered False 03:11:20.326017 bus /gobi_1: Setting Powered False 03:11:21.441947 bus /gobi_0: Setting Powered False 03:11:22.540384 bus /gobi_0: Setting Powered False 03:11:23.659160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 03:11:24.761304 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:24.772342 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:24.812043 tst ping.py: using LAC 25581 03:11:24.930567 tst ping.py: using RAC 81 03:11:25.047871 tst ping.py: using CellId 25581 03:11:25.164393 tst ping.py: using BVCI 25582 03:11:25.273455 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.284000 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.294583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.305424 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.316241 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.326974 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.337870 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:25.348639 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:25.463143 tst ping.py:19: start network... 03:11:25.661827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:26.120202 run create_hlr_db(pid=18237): Launched 03:11:26.234128 bus /gobi_6: Setting Powered False 03:11:27.293369 run create_hlr_db(pid=18237): Terminated: ok {rc=0} 03:11:27.729193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18239): Launched 03:11:28.047467 run osmo-hlr_10.42.42.2(pid=18240): Launched 03:11:28.168827 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:28.722277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18242): Launched 03:11:29.040630 run osmo-stp_10.42.42.5(pid=18243): Launched 03:11:29.161875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:29.709692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18245): Launched 03:11:29.831530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:30.101204 run patchelf(pid=18246): Launched 03:11:30.278319 run osmo-stp_10.42.42.5(pid=18243): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18243)] 03:11:30.413057 run osmo-stp_10.42.42.5(pid=18243): stdout: | (launched: 2022-12-10_03:11:28.982711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:30.549023 run osmo-stp_10.42.42.5(pid=18243): stderr: | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031129176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:30.685187 run osmo-stp_10.42.42.5(pid=18243): stdout: | (launched: 2022-12-10_03:11:28.982711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:30.815145 run osmo-stp_10.42.42.5(pid=18243): stderr: | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031129175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031129176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031129178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:30.997223 run patchelf(pid=18246): Terminating (SIGINT) 03:11:31.176567 run patchelf(pid=18246): Terminated: ok {rc=0} 03:11:31.304202 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18243): Process ended prematurely: osmo-stp_10.42.42.5(pid=18243) [trial-2368↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18243)] [trial-2368↪gprs:nanobts+band-1900↪ping.py:22] 03:11:31.314284 tst ping.py:22: Test FAILED (6.5 sec) 03:11:31.346705 run osmo-hlr_10.42.42.2(pid=18240): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18240)] 03:11:31.398679 run osmo-hlr_10.42.42.2(pid=18240): stdout: | (launched: 2022-12-10_03:11:27.989354) 03:11:31.451856 run osmo-hlr_10.42.42.2(pid=18240): stderr: | [0;m[1;31m20221210031128185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031128185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031128185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031128185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031128186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031128186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031128198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031128206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031128206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031128206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:31.506733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18239): Terminating (SIGTERM) 03:11:31.551619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18242): Terminating (SIGTERM) 03:11:31.597478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18245): Terminating (SIGTERM) 03:11:31.643247 --- ParallelTerminationStrategy: PID 18239 died... 03:11:31.664525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18239): Terminated: ok {rc=0} 03:11:31.715699 --- ParallelTerminationStrategy: PID 18242 died... 03:11:31.736015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18242): Terminated: ok {rc=0} 03:11:31.784457 --- ParallelTerminationStrategy: PID 18245 died... 03:11:31.804714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18245): Terminated: ok {rc=0} 03:11:31.896424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 03:11:32.984574 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:32.996563 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:33.037670 tst ping_idle_ping.py: using LAC 25582 03:11:33.163752 tst ping_idle_ping.py: using RAC 82 03:11:33.287885 tst ping_idle_ping.py: using CellId 25582 03:11:33.412658 tst ping_idle_ping.py: using BVCI 25583 03:11:33.528043 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.539112 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.550147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.561157 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.571970 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.582916 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.593970 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:33.604929 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:33.723969 tst ping_idle_ping.py:24: start network... 03:11:33.938485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:34.432742 run create_hlr_db(pid=18247): Launched 03:11:34.562168 bus /gobi_6: Setting Powered False 03:11:35.620753 run create_hlr_db(pid=18247): Terminated: ok {rc=0} 03:11:36.045226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18249): Launched 03:11:36.342494 run osmo-hlr_10.42.42.2(pid=18250): Launched 03:11:36.455951 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:36.982095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18252): Launched 03:11:37.279086 run osmo-stp_10.42.42.5(pid=18253): Launched 03:11:37.392048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:37.904450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18255): Launched 03:11:38.019112 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:38.271207 run patchelf(pid=18256): Launched 03:11:38.438679 run osmo-stp_10.42.42.5(pid=18253): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18253)] 03:11:38.564721 run osmo-stp_10.42.42.5(pid=18253): stdout: | (launched: 2022-12-10_03:11:37.224472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:38.692817 run osmo-stp_10.42.42.5(pid=18253): stderr: | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031137395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:38.821133 run osmo-stp_10.42.42.5(pid=18253): stdout: | (launched: 2022-12-10_03:11:37.224472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:38.943219 run osmo-stp_10.42.42.5(pid=18253): stderr: | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031137395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031137395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031137396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:39.088153 run patchelf(pid=18256): Terminating (SIGINT) 03:11:39.255153 run patchelf(pid=18256): Terminated: ok {rc=0} 03:11:39.375305 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18253): Process ended prematurely: osmo-stp_10.42.42.5(pid=18253) [trial-2368↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18253)] [trial-2368↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 03:11:39.384050 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:11:39.411298 run osmo-hlr_10.42.42.2(pid=18250): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18250)] 03:11:39.459221 run osmo-hlr_10.42.42.2(pid=18250): stdout: | (launched: 2022-12-10_03:11:36.288044) 03:11:39.509469 run osmo-hlr_10.42.42.2(pid=18250): stderr: | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031136463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031136476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031136487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031136488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031136488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:39.559592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18249): Terminating (SIGTERM) 03:11:39.599601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18252): Terminating (SIGTERM) 03:11:39.639445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18255): Terminating (SIGTERM) 03:11:39.679972 --- ParallelTerminationStrategy: PID 18249 died... 03:11:39.699243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18249): Terminated: ok {rc=0} 03:11:39.743925 --- ParallelTerminationStrategy: PID 18252 died... 03:11:39.762539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18252): Terminated: ok {rc=0} 03:11:39.807142 --- ParallelTerminationStrategy: PID 18255 died... 03:11:39.825901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18255): Terminated: ok {rc=0} 03:11:39.911053 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 03:11:41.205660 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:11:41.211505 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:11:41.235051 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:11:41.273182 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:11:41.358954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:11:41.382068 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:11:41.419992 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:11:42.015161 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:11:42.064214 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.075141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:11:42.115560 tst cs_paging_gprs_active.py: using LAC 25583 03:11:42.236447 tst cs_paging_gprs_active.py: using RAC 83 03:11:42.355576 tst cs_paging_gprs_active.py: using CellId 25583 03:11:42.476137 tst cs_paging_gprs_active.py: using BVCI 25584 03:11:42.596063 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.607725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.619040 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.630552 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.641977 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.653529 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.665202 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.676296 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:42.687824 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:11:42.803190 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:11:42.920554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:11:43.122982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:43.425510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Launched 03:11:43.689966 run iperf3-srv_10.42.42.10(pid=18261): Launched 03:11:43.804184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:11:44.005850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:44.309167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Launched 03:11:44.571440 run iperf3-srv_10.42.42.10(pid=18263): Launched 03:11:44.685917 tst cs_paging_gprs_active.py:38: start network... 03:11:44.887897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:45.355053 run create_hlr_db(pid=18264): Launched 03:11:45.471582 bus /gobi_6: Setting Powered False 03:11:46.541411 run create_hlr_db(pid=18264): Terminated: ok {rc=0} 03:11:47.006144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Launched 03:11:47.337964 run osmo-hlr_10.42.42.2(pid=18267): Launched 03:11:47.462458 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:48.018141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Launched 03:11:48.342342 run osmo-stp_10.42.42.5(pid=18270): Launched 03:11:48.466350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:49.024526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Launched 03:11:49.148568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:49.422023 run patchelf(pid=18273): Launched 03:11:49.602307 run osmo-stp_10.42.42.5(pid=18270): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] 03:11:49.739126 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-10_03:11:48.283081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:49.877562 run osmo-stp_10.42.42.5(pid=18270): stderr: | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031148476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:50.016219 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-10_03:11:48.283081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:50.149672 run osmo-stp_10.42.42.5(pid=18270): stderr: | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031148475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031148476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031148476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:50.306929 run patchelf(pid=18273): Terminating (SIGINT) 03:11:50.487243 run patchelf(pid=18273): Terminated: ok {rc=0} 03:11:50.617672 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:11:50.627711 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:11:50.656141 run osmo-hlr_10.42.42.2(pid=18267): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18267)] 03:11:50.706292 run osmo-hlr_10.42.42.2(pid=18267): stdout: | (launched: 2022-12-10_03:11:47.279145) 03:11:50.758168 run osmo-hlr_10.42.42.2(pid=18267): stderr: | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031147475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031147488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031147496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031147496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031147496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:50.810810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Terminating (SIGTERM) 03:11:50.852488 run iperf3-srv_10.42.42.10(pid=18261): Terminating (SIGTERM) 03:11:50.893936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Terminating (SIGTERM) 03:11:50.935823 run iperf3-srv_10.42.42.10(pid=18263): Terminating (SIGTERM) 03:11:50.977387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminating (SIGTERM) 03:11:51.019344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminating (SIGTERM) 03:11:51.061161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Terminating (SIGTERM) 03:11:51.103372 --- ParallelTerminationStrategy: PID 18260 died... 03:11:51.123476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18260): Terminated: ok {rc=0} 03:11:51.170101 --- ParallelTerminationStrategy: PID 18261 died... 03:11:51.189761 run iperf3-srv_10.42.42.10(pid=18261): Terminated {rc=256} 03:11:51.235871 --- ParallelTerminationStrategy: PID 18262 died... 03:11:51.255569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18262): Terminated: ok {rc=0} 03:11:51.301823 --- ParallelTerminationStrategy: PID 18263 died... 03:11:51.321509 run iperf3-srv_10.42.42.10(pid=18263): Terminated {rc=256} 03:11:51.367576 --- ParallelTerminationStrategy: PID 18266 died... 03:11:51.387303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminated: ok {rc=0} 03:11:51.433663 --- ParallelTerminationStrategy: PID 18269 died... 03:11:51.453391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminated: ok {rc=0} 03:11:51.499720 --- ParallelTerminationStrategy: PID 18272 died... 03:11:51.519566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18272): Terminated: ok {rc=0} 03:11:51.606741 bus /gobi_0: Setting Powered False 03:11:52.706981 bus /gobi_0: Setting Powered False 03:11:53.822109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:11:54.970342 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:54.982637 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:11:55.026747 tst iperf3.py: using LAC 25584 03:11:55.154983 tst iperf3.py: using RAC 84 03:11:55.281073 tst iperf3.py: using CellId 25584 03:11:55.408662 tst iperf3.py: using BVCI 25585 03:11:55.525821 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.537293 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.548422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.559609 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.570655 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.581743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.593024 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.604075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:55.615383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:11:55.733764 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:55.951213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:56.275588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18274): Launched 03:11:56.556483 run iperf3-srv_10.42.42.10(pid=18275): Launched 03:11:56.678185 tst iperf3.py:8: start network... 03:11:56.895040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:57.397638 run create_hlr_db(pid=18276): Launched 03:11:57.529905 bus /gobi_6: Setting Powered False 03:11:58.592723 run create_hlr_db(pid=18276): Terminated: ok {rc=0} 03:11:59.023877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18278): Launched 03:11:59.328485 run osmo-hlr_10.42.42.2(pid=18279): Launched 03:11:59.444880 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:59.971378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18281): Launched 03:12:00.274451 run osmo-stp_10.42.42.5(pid=18282): Launched 03:12:00.389997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:00.933429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18284): Launched 03:12:01.078638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:01.362883 run patchelf(pid=18285): Launched 03:12:01.599852 run osmo-stp_10.42.42.5(pid=18282): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18282)] 03:12:01.750756 run osmo-stp_10.42.42.5(pid=18282): stdout: | (launched: 2022-12-10_03:12:00.218946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:01.894182 run osmo-stp_10.42.42.5(pid=18282): stderr: | [0;m[38;5;43m20221210031200390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031200390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031200391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031200391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:02.036171 run osmo-stp_10.42.42.5(pid=18282): stdout: | (launched: 2022-12-10_03:12:00.218946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:02.173533 run osmo-stp_10.42.42.5(pid=18282): stderr: | [0;m[38;5;43m20221210031200390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031200390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031200391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031200391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031200392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:02.333105 run patchelf(pid=18285): Terminating (SIGINT) 03:12:02.514654 run patchelf(pid=18285): Terminated: ok {rc=0} 03:12:02.645544 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18282): Process ended prematurely: osmo-stp_10.42.42.5(pid=18282) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18282)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 03:12:02.655770 tst iperf3.py:8: Test FAILED (7.7 sec) 03:12:02.684587 run osmo-hlr_10.42.42.2(pid=18279): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18279)] 03:12:02.735045 run osmo-hlr_10.42.42.2(pid=18279): stdout: | (launched: 2022-12-10_03:11:59.272488) 03:12:02.787415 run osmo-hlr_10.42.42.2(pid=18279): stderr: | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031159448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031159460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031159469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031159469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031159469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:02.840240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18274): Terminating (SIGTERM) 03:12:02.882179 run iperf3-srv_10.42.42.10(pid=18275): Terminating (SIGTERM) 03:12:02.924014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18278): Terminating (SIGTERM) 03:12:02.966110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18281): Terminating (SIGTERM) 03:12:03.008125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18284): Terminating (SIGTERM) 03:12:03.050769 --- ParallelTerminationStrategy: PID 18274 died... 03:12:03.071069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18274): Terminated: ok {rc=0} 03:12:03.117931 --- ParallelTerminationStrategy: PID 18275 died... 03:12:03.137684 run iperf3-srv_10.42.42.10(pid=18275): Terminated {rc=256} 03:12:03.183785 --- ParallelTerminationStrategy: PID 18278 died... 03:12:03.203544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18278): Terminated: ok {rc=0} 03:12:03.249470 --- ParallelTerminationStrategy: PID 18281 died... 03:12:03.269098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18281): Terminated: ok {rc=0} 03:12:03.315230 --- ParallelTerminationStrategy: PID 18284 died... 03:12:03.334962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18284): Terminated: ok {rc=0} 03:12:03.423648 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:12:04.574301 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:04.586283 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:04.628344 tst iperf3m4.py: using LAC 25585 03:12:04.756557 tst iperf3m4.py: using RAC 85 03:12:04.883049 tst iperf3m4.py: using CellId 25585 03:12:05.012298 tst iperf3m4.py: using BVCI 25586 03:12:05.131229 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.142749 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.154010 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.165226 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.176298 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.187499 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.198926 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.210015 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:05.221297 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:05.339730 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:05.457091 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:05.576174 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:05.695928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:05.913510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:06.237375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18286): Launched 03:12:06.520595 run iperf3-srv_10.42.42.10(pid=18287): Launched 03:12:06.642552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:12:06.859152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:07.182973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18288): Launched 03:12:07.464630 run iperf3-srv_10.42.42.10(pid=18289): Launched 03:12:07.586199 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:12:07.802949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:08.127088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18290): Launched 03:12:08.408010 run iperf3-srv_10.42.42.10(pid=18291): Launched 03:12:08.529911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:12:08.746089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:09.069479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18292): Launched 03:12:09.350348 run iperf3-srv_10.42.42.10(pid=18293): Launched 03:12:09.471407 tst iperf3m4.py:8: start network... 03:12:09.688068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:10.189674 run create_hlr_db(pid=18294): Launched 03:12:10.322636 bus /gobi_6: Setting Powered False 03:12:11.385653 run create_hlr_db(pid=18294): Terminated: ok {rc=0} 03:12:11.816889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18296): Launched 03:12:12.119869 run osmo-hlr_10.42.42.2(pid=18297): Launched 03:12:12.235691 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:12.776043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18299): Launched 03:12:13.078188 run osmo-stp_10.42.42.5(pid=18300): Launched 03:12:13.193904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:13.713713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18302): Launched 03:12:13.830270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:14.085990 run patchelf(pid=18303): Launched 03:12:14.254269 run osmo-stp_10.42.42.5(pid=18300): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18300)] 03:12:14.382284 run osmo-stp_10.42.42.5(pid=18300): stdout: | (launched: 2022-12-10_03:12:13.022459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:14.510726 run osmo-stp_10.42.42.5(pid=18300): stderr: | [0;m[38;5;43m20221210031213193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031213193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031213194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031213194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031213194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031213194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031213195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:14.639537 run osmo-stp_10.42.42.5(pid=18300): stdout: | (launched: 2022-12-10_03:12:13.022459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:14.763218 run osmo-stp_10.42.42.5(pid=18300): stderr: | [0;m[38;5;43m20221210031213193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031213193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031213194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031213194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031213194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031213194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031213195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:14.908876 run patchelf(pid=18303): Terminating (SIGINT) 03:12:15.078542 run patchelf(pid=18303): Terminated: ok {rc=0} 03:12:15.200834 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18300): Process ended prematurely: osmo-stp_10.42.42.5(pid=18300) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18300)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 03:12:15.210248 tst iperf3m4.py:8: Test FAILED (10.7 sec) 03:12:15.238177 run osmo-hlr_10.42.42.2(pid=18297): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18297)] 03:12:15.285851 run osmo-hlr_10.42.42.2(pid=18297): stdout: | (launched: 2022-12-10_03:12:12.064358) 03:12:15.335205 run osmo-hlr_10.42.42.2(pid=18297): stderr: | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031212240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031212253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031212262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031212262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031212262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:15.385706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18286): Terminating (SIGTERM) 03:12:15.425490 run iperf3-srv_10.42.42.10(pid=18287): Terminating (SIGTERM) 03:12:15.465117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18288): Terminating (SIGTERM) 03:12:15.504881 run iperf3-srv_10.42.42.10(pid=18289): Terminating (SIGTERM) 03:12:15.544544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18290): Terminating (SIGTERM) 03:12:15.584255 run iperf3-srv_10.42.42.10(pid=18291): Terminating (SIGTERM) 03:12:15.623825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18292): Terminating (SIGTERM) 03:12:15.663567 run iperf3-srv_10.42.42.10(pid=18293): Terminating (SIGTERM) 03:12:15.703084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18296): Terminating (SIGTERM) 03:12:15.742436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18299): Terminating (SIGTERM) 03:12:15.782289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18302): Terminating (SIGTERM) 03:12:15.822308 --- ParallelTerminationStrategy: PID 18286 died... 03:12:15.856414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18286): Terminated: ok {rc=0} 03:12:15.912516 --- ParallelTerminationStrategy: PID 18287 died... 03:12:15.931670 run iperf3-srv_10.42.42.10(pid=18287): Terminated {rc=256} 03:12:15.976482 --- ParallelTerminationStrategy: PID 18288 died... 03:12:15.995606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18288): Terminated: ok {rc=0} 03:12:16.047193 --- ParallelTerminationStrategy: PID 18289 died... 03:12:16.066375 run iperf3-srv_10.42.42.10(pid=18289): Terminated {rc=256} 03:12:16.111461 --- ParallelTerminationStrategy: PID 18290 died... 03:12:16.130629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18290): Terminated: ok {rc=0} 03:12:16.175718 --- ParallelTerminationStrategy: PID 18291 died... 03:12:16.194833 run iperf3-srv_10.42.42.10(pid=18291): Terminated {rc=256} 03:12:16.243599 --- ParallelTerminationStrategy: PID 18292 died... 03:12:16.269638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18292): Terminated: ok {rc=0} 03:12:16.327606 --- ParallelTerminationStrategy: PID 18293 died... 03:12:16.347888 run iperf3-srv_10.42.42.10(pid=18293): Terminated {rc=256} 03:12:16.395090 --- ParallelTerminationStrategy: PID 18296 died... 03:12:16.415148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18296): Terminated: ok {rc=0} 03:12:16.462655 --- ParallelTerminationStrategy: PID 18299 died... 03:12:16.482855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18299): Terminated: ok {rc=0} 03:12:16.530206 --- ParallelTerminationStrategy: PID 18302 died... 03:12:16.550499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18302): Terminated: ok {rc=0} 03:12:16.639433 bus /gobi_4: Setting Powered False 03:12:17.739535 bus /gobi_4: Setting Powered False 03:12:18.857437 bus /gobi_1: Setting Powered False 03:12:19.957160 bus /gobi_1: Setting Powered False 03:12:21.075377 bus /gobi_0: Setting Powered False 03:12:22.175179 bus /gobi_0: Setting Powered False 03:12:23.292493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 03:12:24.396495 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.408573 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:24.450957 tst ping.py: using LAC 25586 03:12:24.580131 tst ping.py: using RAC 86 03:12:24.704071 tst ping.py: using CellId 25586 03:12:24.826758 tst ping.py: using BVCI 25587 03:12:24.941615 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.953295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.964628 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.975841 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.986959 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:24.998188 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:25.009600 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:25.020650 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:25.140702 tst ping.py:19: start network... 03:12:25.353079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:25.841373 run create_hlr_db(pid=18304): Launched 03:12:25.970566 bus /gobi_6: Setting Powered False 03:12:27.033555 run create_hlr_db(pid=18304): Terminated: ok {rc=0} 03:12:27.457620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Launched 03:12:27.756066 run osmo-hlr_10.42.42.2(pid=18307): Launched 03:12:27.869277 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:28.384255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Launched 03:12:28.681299 run osmo-stp_10.42.42.5(pid=18310): Launched 03:12:28.794789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:29.307505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18312): Launched 03:12:29.421653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:29.672044 run patchelf(pid=18313): Launched 03:12:29.838491 run osmo-stp_10.42.42.5(pid=18310): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] 03:12:29.964631 run osmo-stp_10.42.42.5(pid=18310): stdout: | (launched: 2022-12-10_03:12:28.626650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:30.093192 run osmo-stp_10.42.42.5(pid=18310): stderr: | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031228796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:30.221181 run osmo-stp_10.42.42.5(pid=18310): stdout: | (launched: 2022-12-10_03:12:28.626650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:30.343475 run osmo-stp_10.42.42.5(pid=18310): stderr: | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031228795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031228796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031228798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:30.488532 run patchelf(pid=18313): Terminating (SIGINT) 03:12:30.655808 run patchelf(pid=18313): Terminated: ok {rc=0} 03:12:30.776009 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18310): Process ended prematurely: osmo-stp_10.42.42.5(pid=18310) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 03:12:30.784880 tst ping.py:22: Test FAILED (6.4 sec) 03:12:30.812484 run osmo-hlr_10.42.42.2(pid=18307): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18307)] 03:12:30.863014 run osmo-hlr_10.42.42.2(pid=18307): stdout: | (launched: 2022-12-10_03:12:27.701752) 03:12:30.919410 run osmo-hlr_10.42.42.2(pid=18307): stderr: | [0;m[1;31m20221210031227875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031227875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031227875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031227875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031227875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031227876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031227887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:30.972278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Terminating (SIGTERM) 03:12:31.014615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Terminating (SIGTERM) 03:12:31.057083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18312): Terminating (SIGTERM) 03:12:31.099763 --- ParallelTerminationStrategy: PID 18306 died... 03:12:31.119801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18306): Terminated: ok {rc=0} 03:12:31.167746 --- ParallelTerminationStrategy: PID 18309 died... 03:12:31.187639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18309): Terminated: ok {rc=0} 03:12:31.235212 --- ParallelTerminationStrategy: PID 18312 died... 03:12:31.255024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18312): Terminated: ok {rc=0} 03:12:31.344095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:12:32.430169 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:32.442295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:32.485238 tst ping_idle_ping.py: using LAC 25587 03:12:32.604122 tst ping_idle_ping.py: using RAC 87 03:12:32.722635 tst ping_idle_ping.py: using CellId 25587 03:12:32.840347 tst ping_idle_ping.py: using BVCI 25588 03:12:32.950196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:32.961241 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:32.971927 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:32.982931 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:32.993899 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:33.004640 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:33.016075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:33.026941 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:33.145258 tst ping_idle_ping.py:24: start network... 03:12:33.358250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:33.856479 run create_hlr_db(pid=18314): Launched 03:12:33.987270 bus /gobi_6: Setting Powered False 03:12:35.050528 run create_hlr_db(pid=18314): Terminated: ok {rc=0} 03:12:35.476867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Launched 03:12:35.775605 run osmo-hlr_10.42.42.2(pid=18317): Launched 03:12:35.891324 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:36.428109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Launched 03:12:36.727904 run osmo-stp_10.42.42.5(pid=18320): Launched 03:12:36.842095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:37.354009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18322): Launched 03:12:37.468213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:37.718916 run patchelf(pid=18323): Launched 03:12:37.885130 run osmo-stp_10.42.42.5(pid=18320): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] 03:12:38.011207 run osmo-stp_10.42.42.5(pid=18320): stdout: | (launched: 2022-12-10_03:12:36.672836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:38.138440 run osmo-stp_10.42.42.5(pid=18320): stderr: | [0;m[38;5;43m20221210031236840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031236841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031236841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031236841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:38.265873 run osmo-stp_10.42.42.5(pid=18320): stdout: | (launched: 2022-12-10_03:12:36.672836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:38.387813 run osmo-stp_10.42.42.5(pid=18320): stderr: | [0;m[38;5;43m20221210031236840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031236841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031236841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031236841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031236842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:38.531992 run patchelf(pid=18323): Terminating (SIGINT) 03:12:38.698954 run patchelf(pid=18323): Terminated: ok {rc=0} 03:12:38.819273 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18320): Process ended prematurely: osmo-stp_10.42.42.5(pid=18320) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:12:38.827977 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:12:38.855196 run osmo-hlr_10.42.42.2(pid=18317): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18317)] 03:12:38.903057 run osmo-hlr_10.42.42.2(pid=18317): stdout: | (launched: 2022-12-10_03:12:35.720854) 03:12:38.952388 run osmo-hlr_10.42.42.2(pid=18317): stderr: | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031235899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031235916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031235929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031235929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031235929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:39.002228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Terminating (SIGTERM) 03:12:39.041827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Terminating (SIGTERM) 03:12:39.081310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18322): Terminating (SIGTERM) 03:12:39.121730 --- ParallelTerminationStrategy: PID 18316 died... 03:12:39.140676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18316): Terminated: ok {rc=0} 03:12:39.185203 --- ParallelTerminationStrategy: PID 18319 died... 03:12:39.203763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18319): Terminated: ok {rc=0} 03:12:39.247891 --- ParallelTerminationStrategy: PID 18322 died... 03:12:39.266425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18322): Terminated: ok {rc=0} 03:12:39.349081 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:12:40.638906 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:12:40.645612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:12:40.669978 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:12:40.709457 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:12:40.795953 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:12:40.819923 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:12:40.857880 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:12:41.450804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:12:41.499371 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:41.510244 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:12:41.569422 tst cs_paging_gprs_active.py: using LAC 25588 03:12:41.690251 tst cs_paging_gprs_active.py: using RAC 88 03:12:41.817485 tst cs_paging_gprs_active.py: using CellId 25588 03:12:41.942244 tst cs_paging_gprs_active.py: using BVCI 25589 03:12:42.054228 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.065183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.075986 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.086955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.098020 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.108908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.120017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.130814 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:42.141993 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:12:42.257549 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:12:42.375609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:12:42.579012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:42.883226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Launched 03:12:43.147593 run iperf3-srv_10.42.42.10(pid=18328): Launched 03:12:43.262238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:12:43.464740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:43.767889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Launched 03:12:44.030624 run iperf3-srv_10.42.42.10(pid=18330): Launched 03:12:44.144806 tst cs_paging_gprs_active.py:38: start network... 03:12:44.347073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:44.815101 run create_hlr_db(pid=18331): Launched 03:12:44.930962 bus /gobi_6: Setting Powered False 03:12:46.003390 run create_hlr_db(pid=18331): Terminated: ok {rc=0} 03:12:46.479088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18333): Launched 03:12:46.826553 run osmo-hlr_10.42.42.2(pid=18334): Launched 03:12:47.080319 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:47.658467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18336): Launched 03:12:47.965322 run osmo-stp_10.42.42.5(pid=18337): Launched 03:12:48.081900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:48.603029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18339): Launched 03:12:48.718992 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:48.973568 run patchelf(pid=18340): Launched 03:12:49.142736 run osmo-stp_10.42.42.5(pid=18337): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18337)] 03:12:49.270973 run osmo-stp_10.42.42.5(pid=18337): stdout: | (launched: 2022-12-10_03:12:47.909880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:49.401069 run osmo-stp_10.42.42.5(pid=18337): stderr: | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031248078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:49.530964 run osmo-stp_10.42.42.5(pid=18337): stdout: | (launched: 2022-12-10_03:12:47.909880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:49.655219 run osmo-stp_10.42.42.5(pid=18337): stderr: | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031248078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031248078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031248079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:49.802370 run patchelf(pid=18340): Terminating (SIGINT) 03:12:49.972344 run patchelf(pid=18340): Terminated: ok {rc=0} 03:12:50.095358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18337): Process ended prematurely: osmo-stp_10.42.42.5(pid=18337) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18337)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:12:50.104714 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:12:50.132360 run osmo-hlr_10.42.42.2(pid=18334): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18334)] 03:12:50.179981 run osmo-hlr_10.42.42.2(pid=18334): stdout: | (launched: 2022-12-10_03:12:46.759520) 03:12:50.229514 run osmo-hlr_10.42.42.2(pid=18334): stderr: | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031247067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031247086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031247099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031247099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031247099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:50.279761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Terminating (SIGTERM) 03:12:50.319674 run iperf3-srv_10.42.42.10(pid=18328): Terminating (SIGTERM) 03:12:50.359481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Terminating (SIGTERM) 03:12:50.399366 run iperf3-srv_10.42.42.10(pid=18330): Terminating (SIGTERM) 03:12:50.439127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18333): Terminating (SIGTERM) 03:12:50.479542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18336): Terminating (SIGTERM) 03:12:50.519399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18339): Terminating (SIGTERM) 03:12:50.559440 --- ParallelTerminationStrategy: PID 18327 died... 03:12:50.578633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18327): Terminated: ok {rc=0} 03:12:50.623540 --- ParallelTerminationStrategy: PID 18328 died... 03:12:50.642217 run iperf3-srv_10.42.42.10(pid=18328): Terminated {rc=256} 03:12:50.686387 --- ParallelTerminationStrategy: PID 18329 died... 03:12:50.704918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18329): Terminated: ok {rc=0} 03:12:50.749040 --- ParallelTerminationStrategy: PID 18330 died... 03:12:50.767572 run iperf3-srv_10.42.42.10(pid=18330): Terminated {rc=256} 03:12:50.811679 --- ParallelTerminationStrategy: PID 18333 died... 03:12:50.830398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18333): Terminated: ok {rc=0} 03:12:50.874643 --- ParallelTerminationStrategy: PID 18336 died... 03:12:50.893265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18336): Terminated: ok {rc=0} 03:12:50.937390 --- ParallelTerminationStrategy: PID 18339 died... 03:12:50.955871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18339): Terminated: ok {rc=0} 03:12:51.042014 bus /gobi_0: Setting Powered False 03:12:52.145415 bus /gobi_0: Setting Powered False 03:12:53.261633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:12:54.411512 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:54.423605 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:12:54.487928 tst iperf3.py: using LAC 25589 03:12:54.613152 tst iperf3.py: using RAC 89 03:12:54.739106 tst iperf3.py: using CellId 25589 03:12:54.864733 tst iperf3.py: using BVCI 25590 03:12:54.981673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:54.992935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.004199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.015584 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.026844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.038050 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.049382 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.060416 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:55.071915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:12:55.187296 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:55.390310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:55.694421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18341): Launched 03:12:55.957957 run iperf3-srv_10.42.42.10(pid=18342): Launched 03:12:56.072426 tst iperf3.py:8: start network... 03:12:56.274240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:56.741836 run create_hlr_db(pid=18343): Launched 03:12:56.857973 bus /gobi_6: Setting Powered False 03:12:57.917486 run create_hlr_db(pid=18343): Terminated: ok {rc=0} 03:12:58.357206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18345): Launched 03:12:58.679758 run osmo-hlr_10.42.42.2(pid=18346): Launched 03:12:58.803419 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:59.359972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18348): Launched 03:12:59.682033 run osmo-stp_10.42.42.5(pid=18349): Launched 03:12:59.805315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:00.363108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18351): Launched 03:13:00.487351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:00.761054 run patchelf(pid=18352): Launched 03:13:00.948482 run osmo-stp_10.42.42.5(pid=18349): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18349)] 03:13:01.087845 run osmo-stp_10.42.42.5(pid=18349): stdout: | (launched: 2022-12-10_03:12:59.623244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:01.227908 run osmo-stp_10.42.42.5(pid=18349): stderr: | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031259817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:01.368228 run osmo-stp_10.42.42.5(pid=18349): stdout: | (launched: 2022-12-10_03:12:59.623244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:01.503297 run osmo-stp_10.42.42.5(pid=18349): stderr: | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031259816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031259817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031259817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:01.663014 run patchelf(pid=18352): Terminating (SIGINT) 03:13:01.847690 run patchelf(pid=18352): Terminated: ok {rc=0} 03:13:01.981460 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18349): Process ended prematurely: osmo-stp_10.42.42.5(pid=18349) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18349)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:13:01.992255 tst iperf3.py:8: Test FAILED (7.6 sec) 03:13:02.021752 run osmo-hlr_10.42.42.2(pid=18346): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18346)] 03:13:02.072771 run osmo-hlr_10.42.42.2(pid=18346): stdout: | (launched: 2022-12-10_03:12:58.621024) 03:13:02.125962 run osmo-hlr_10.42.42.2(pid=18346): stderr: | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031258821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031258833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031258841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031258841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031258841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:02.179169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18341): Terminating (SIGTERM) 03:13:02.221884 run iperf3-srv_10.42.42.10(pid=18342): Terminating (SIGTERM) 03:13:02.263740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18345): Terminating (SIGTERM) 03:13:02.305663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18348): Terminating (SIGTERM) 03:13:02.347561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18351): Terminating (SIGTERM) 03:13:02.389793 --- ParallelTerminationStrategy: PID 18341 died... 03:13:02.409904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18341): Terminated: ok {rc=0} 03:13:02.456609 --- ParallelTerminationStrategy: PID 18342 died... 03:13:02.476301 run iperf3-srv_10.42.42.10(pid=18342): Terminated {rc=256} 03:13:02.522728 --- ParallelTerminationStrategy: PID 18345 died... 03:13:02.542662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18345): Terminated: ok {rc=0} 03:13:02.589141 --- ParallelTerminationStrategy: PID 18348 died... 03:13:02.608752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18348): Terminated: ok {rc=0} 03:13:02.655424 --- ParallelTerminationStrategy: PID 18351 died... 03:13:02.675295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18351): Terminated: ok {rc=0} 03:13:02.763329 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:13:03.910468 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:03.922157 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:03.982381 tst iperf3m4.py: using LAC 25590 03:13:04.101820 tst iperf3m4.py: using RAC 90 03:13:04.223761 tst iperf3m4.py: using CellId 25590 03:13:04.352809 tst iperf3m4.py: using BVCI 25591 03:13:04.470405 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.482025 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.493398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.504722 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.515973 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.527110 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.538522 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.549666 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:04.560895 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:04.682130 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:04.808168 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:04.926209 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:05.046344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:13:05.264296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:05.588183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Launched 03:13:05.870589 run iperf3-srv_10.42.42.10(pid=18354): Launched 03:13:05.993169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:13:06.211067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:06.535412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Launched 03:13:06.816139 run iperf3-srv_10.42.42.10(pid=18356): Launched 03:13:06.937937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:13:07.154865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:07.478873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Launched 03:13:07.759492 run iperf3-srv_10.42.42.10(pid=18358): Launched 03:13:07.881020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:13:08.097987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:08.422177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18359): Launched 03:13:08.702508 run iperf3-srv_10.42.42.10(pid=18360): Launched 03:13:08.825163 tst iperf3m4.py:8: start network... 03:13:09.042513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:09.543130 run create_hlr_db(pid=18361): Launched 03:13:09.674077 bus /gobi_6: Setting Powered False 03:13:10.738346 run create_hlr_db(pid=18361): Terminated: ok {rc=0} 03:13:11.189080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Launched 03:13:11.512462 run osmo-hlr_10.42.42.2(pid=18364): Launched 03:13:11.635828 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:12.193506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Launched 03:13:12.517563 run osmo-stp_10.42.42.5(pid=18367): Launched 03:13:12.641047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:13.202178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Launched 03:13:13.325796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:13.598938 run patchelf(pid=18370): Launched 03:13:13.779162 run osmo-stp_10.42.42.5(pid=18367): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] 03:13:13.915414 run osmo-stp_10.42.42.5(pid=18367): stdout: | (launched: 2022-12-10_03:13:12.458234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:14.054098 run osmo-stp_10.42.42.5(pid=18367): stderr: | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031312653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:14.191850 run osmo-stp_10.42.42.5(pid=18367): stdout: | (launched: 2022-12-10_03:13:12.458234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:14.324543 run osmo-stp_10.42.42.5(pid=18367): stderr: | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031312652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031312653 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031312653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:14.481916 run patchelf(pid=18370): Terminating (SIGINT) 03:13:14.662879 run patchelf(pid=18370): Terminated: ok {rc=0} 03:13:14.793339 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18367): Process ended prematurely: osmo-stp_10.42.42.5(pid=18367) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:13:14.803617 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:13:14.832701 run osmo-hlr_10.42.42.2(pid=18364): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18364)] 03:13:14.882941 run osmo-hlr_10.42.42.2(pid=18364): stdout: | (launched: 2022-12-10_03:13:11.453382) 03:13:14.934999 run osmo-hlr_10.42.42.2(pid=18364): stderr: | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031311653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031311666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031311674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031311674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031311674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:14.987729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminating (SIGTERM) 03:13:15.029900 run iperf3-srv_10.42.42.10(pid=18354): Terminating (SIGTERM) 03:13:15.072070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminating (SIGTERM) 03:13:15.114280 run iperf3-srv_10.42.42.10(pid=18356): Terminating (SIGTERM) 03:13:15.156193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Terminating (SIGTERM) 03:13:15.198326 run iperf3-srv_10.42.42.10(pid=18358): Terminating (SIGTERM) 03:13:15.240163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18359): Terminating (SIGTERM) 03:13:15.282127 run iperf3-srv_10.42.42.10(pid=18360): Terminating (SIGTERM) 03:13:15.324372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Terminating (SIGTERM) 03:13:15.366302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Terminating (SIGTERM) 03:13:15.408062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Terminating (SIGTERM) 03:13:15.450184 --- ParallelTerminationStrategy: PID 18353 died... 03:13:15.470198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18353): Terminated: ok {rc=0} 03:13:15.516385 --- ParallelTerminationStrategy: PID 18354 died... 03:13:15.536017 run iperf3-srv_10.42.42.10(pid=18354): Terminated {rc=256} 03:13:15.582054 --- ParallelTerminationStrategy: PID 18355 died... 03:13:15.601815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18355): Terminated: ok {rc=0} 03:13:15.648050 --- ParallelTerminationStrategy: PID 18356 died... 03:13:15.667686 run iperf3-srv_10.42.42.10(pid=18356): Terminated {rc=256} 03:13:15.713504 --- ParallelTerminationStrategy: PID 18357 died... 03:13:15.733283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18357): Terminated: ok {rc=0} 03:13:15.779247 --- ParallelTerminationStrategy: PID 18358 died... 03:13:15.798793 run iperf3-srv_10.42.42.10(pid=18358): Terminated {rc=256} 03:13:15.844903 --- ParallelTerminationStrategy: PID 18359 died... 03:13:15.864736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18359): Terminated: ok {rc=0} 03:13:15.911273 --- ParallelTerminationStrategy: PID 18360 died... 03:13:15.931073 run iperf3-srv_10.42.42.10(pid=18360): Terminated {rc=256} 03:13:15.977683 --- ParallelTerminationStrategy: PID 18363 died... 03:13:15.997750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Terminated: ok {rc=0} 03:13:16.044490 --- ParallelTerminationStrategy: PID 18366 died... 03:13:16.064338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Terminated: ok {rc=0} 03:13:16.110925 --- ParallelTerminationStrategy: PID 18369 died... 03:13:16.130937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Terminated: ok {rc=0} 03:13:16.223103 bus /gobi_4: Setting Powered False 03:13:17.325445 bus /gobi_4: Setting Powered False 03:13:18.440278 bus /gobi_1: Setting Powered False 03:13:19.537678 bus /gobi_1: Setting Powered False 03:13:20.653996 bus /gobi_0: Setting Powered False 03:13:21.755333 bus /gobi_0: Setting Powered False 03:13:22.875571 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:13:23.980088 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:23.991800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:24.051556 tst ping.py: using LAC 25591 03:13:24.169164 tst ping.py: using RAC 91 03:13:24.291625 tst ping.py: using CellId 25591 03:13:24.407524 tst ping.py: using BVCI 25592 03:13:24.515240 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.526339 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.537159 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.548184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.559237 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.570274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.581545 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:24.592494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:24.706607 tst ping.py:19: start network... 03:13:24.921943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:25.414532 run create_hlr_db(pid=18371): Launched 03:13:25.544249 bus /gobi_6: Setting Powered False 03:13:26.607974 run create_hlr_db(pid=18371): Terminated: ok {rc=0} 03:13:27.033539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18373): Launched 03:13:27.331823 run osmo-hlr_10.42.42.2(pid=18374): Launched 03:13:27.445356 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:27.962355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18376): Launched 03:13:28.258448 run osmo-stp_10.42.42.5(pid=18377): Launched 03:13:28.371613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:28.881259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18379): Launched 03:13:28.995530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:29.244831 run patchelf(pid=18380): Launched 03:13:29.410558 run osmo-stp_10.42.42.5(pid=18377): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18377)] 03:13:29.536004 run osmo-stp_10.42.42.5(pid=18377): stdout: | (launched: 2022-12-10_03:13:28.203804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:29.662684 run osmo-stp_10.42.42.5(pid=18377): stderr: | [0;m[38;5;43m20221210031328373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031328373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031328374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031328374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:29.789692 run osmo-stp_10.42.42.5(pid=18377): stdout: | (launched: 2022-12-10_03:13:28.203804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:29.911140 run osmo-stp_10.42.42.5(pid=18377): stderr: | [0;m[38;5;43m20221210031328373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031328373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031328374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031328374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031328375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:30.054890 run patchelf(pid=18380): Terminating (SIGINT) 03:13:30.221393 run patchelf(pid=18380): Terminated: ok {rc=0} 03:13:30.341069 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18377): Process ended prematurely: osmo-stp_10.42.42.5(pid=18377) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18377)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 03:13:30.349833 tst ping.py:22: Test FAILED (6.4 sec) 03:13:30.376821 run osmo-hlr_10.42.42.2(pid=18374): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18374)] 03:13:30.424261 run osmo-hlr_10.42.42.2(pid=18374): stdout: | (launched: 2022-12-10_03:13:27.277093) 03:13:30.473619 run osmo-hlr_10.42.42.2(pid=18374): stderr: | [0;m[1;31m20221210031327450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031327450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031327451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031327451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031327451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031327451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031327493 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031327503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031327504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031327504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:30.522977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18373): Terminating (SIGTERM) 03:13:30.562719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18376): Terminating (SIGTERM) 03:13:30.602536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18379): Terminating (SIGTERM) 03:13:30.642567 --- ParallelTerminationStrategy: PID 18373 died... 03:13:30.661671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18373): Terminated: ok {rc=0} 03:13:30.706102 --- ParallelTerminationStrategy: PID 18376 died... 03:13:30.724633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18376): Terminated: ok {rc=0} 03:13:30.769199 --- ParallelTerminationStrategy: PID 18379 died... 03:13:30.787785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18379): Terminated: ok {rc=0} 03:13:30.877443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:13:31.978382 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:31.991485 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:32.054352 tst ping_idle_ping.py: using LAC 25592 03:13:32.224920 tst ping_idle_ping.py: using RAC 92 03:13:32.346991 tst ping_idle_ping.py: using CellId 25592 03:13:32.466252 tst ping_idle_ping.py: using BVCI 25593 03:13:32.576746 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.587871 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.598974 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.610612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.622111 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.633791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.645502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:32.657132 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:32.772776 tst ping_idle_ping.py:24: start network... 03:13:32.971896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:33.431506 run create_hlr_db(pid=18381): Launched 03:13:33.544936 bus /gobi_6: Setting Powered False 03:13:34.604913 run create_hlr_db(pid=18381): Terminated: ok {rc=0} 03:13:35.021486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Launched 03:13:35.320538 run osmo-hlr_10.42.42.2(pid=18384): Launched 03:13:35.434114 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:35.958508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Launched 03:13:36.254255 run osmo-stp_10.42.42.5(pid=18387): Launched 03:13:36.367882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:36.878117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Launched 03:13:36.992308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:37.241954 run patchelf(pid=18390): Launched 03:13:37.407420 run osmo-stp_10.42.42.5(pid=18387): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] 03:13:37.533232 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-10_03:13:36.200067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:37.660827 run osmo-stp_10.42.42.5(pid=18387): stderr: | [0;m[38;5;43m20221210031336368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031336369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031336369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031336369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:37.788081 run osmo-stp_10.42.42.5(pid=18387): stdout: | (launched: 2022-12-10_03:13:36.200067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:37.909834 run osmo-stp_10.42.42.5(pid=18387): stderr: | [0;m[38;5;43m20221210031336368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031336369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031336369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031336369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031336370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:38.054336 run patchelf(pid=18390): Terminating (SIGINT) 03:13:38.221304 run patchelf(pid=18390): Terminated: ok {rc=0} 03:13:38.341293 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:13:38.349981 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:13:38.376715 run osmo-hlr_10.42.42.2(pid=18384): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18384)] 03:13:38.424601 run osmo-hlr_10.42.42.2(pid=18384): stdout: | (launched: 2022-12-10_03:13:35.265487) 03:13:38.474173 run osmo-hlr_10.42.42.2(pid=18384): stderr: | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031335442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031335454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031335464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031335464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031335465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:38.524099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminating (SIGTERM) 03:13:38.564301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminating (SIGTERM) 03:13:38.604463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Terminating (SIGTERM) 03:13:38.644910 --- ParallelTerminationStrategy: PID 18383 died... 03:13:38.664231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18383): Terminated: ok {rc=0} 03:13:38.708742 --- ParallelTerminationStrategy: PID 18386 died... 03:13:38.727512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18386): Terminated: ok {rc=0} 03:13:38.771845 --- ParallelTerminationStrategy: PID 18389 died... 03:13:38.790529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18389): Terminated: ok {rc=0} 03:13:38.876198 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:13:40.178955 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:13:40.187701 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:13:40.212500 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:13:40.246858 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:13:40.300843 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:13:40.324777 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:13:40.359019 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:13:40.918992 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:13:40.923950 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:40.935391 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:13:41.000314 tst switch_tch_pdch.py: using LAC 25593 03:13:41.126569 tst switch_tch_pdch.py: using RAC 93 03:13:41.250124 tst switch_tch_pdch.py: using CellId 25593 03:13:41.373749 tst switch_tch_pdch.py: using BVCI 25594 03:13:41.488914 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.501115 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.512841 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.525422 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.537736 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.549973 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.562556 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:41.575354 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:13:41.695246 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:13:41.810581 tst switch_tch_pdch.py:51: start network... 03:13:42.009699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:42.468722 run create_hlr_db(pid=18394): Launched 03:13:42.583090 bus /gobi_6: Setting Powered False 03:13:43.641366 run create_hlr_db(pid=18394): Terminated: ok {rc=0} 03:13:44.056352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Launched 03:13:44.353402 run osmo-hlr_10.42.42.2(pid=18398): Launched 03:13:44.467029 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:44.989427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Launched 03:13:45.286101 run osmo-stp_10.42.42.5(pid=18401): Launched 03:13:45.399037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:45.946540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Launched 03:13:46.085660 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:46.433695 run patchelf(pid=18404): Launched 03:13:46.662004 run osmo-stp_10.42.42.5(pid=18401): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] 03:13:46.829634 run osmo-stp_10.42.42.5(pid=18401): stdout: | (launched: 2022-12-10_03:13:45.231422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:46.975290 run osmo-stp_10.42.42.5(pid=18401): stderr: | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031345402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:47.118441 run osmo-stp_10.42.42.5(pid=18401): stdout: | (launched: 2022-12-10_03:13:45.231422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:47.251672 run osmo-stp_10.42.42.5(pid=18401): stderr: | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031345401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031345402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031345404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:47.409454 run patchelf(pid=18404): Terminating (SIGINT) 03:13:47.587909 run patchelf(pid=18404): Terminated: ok {rc=0} 03:13:47.716204 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18401): Process ended prematurely: osmo-stp_10.42.42.5(pid=18401) [trial-2368↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] [trial-2368↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:13:47.725727 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 03:13:47.753829 run osmo-hlr_10.42.42.2(pid=18398): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18398)] 03:13:47.804224 run osmo-hlr_10.42.42.2(pid=18398): stdout: | (launched: 2022-12-10_03:13:44.298877) 03:13:47.856395 run osmo-hlr_10.42.42.2(pid=18398): stderr: | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031344473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031344486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031344496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031344496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031344496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:47.908797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Terminating (SIGTERM) 03:13:47.950678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Terminating (SIGTERM) 03:13:47.992837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Terminating (SIGTERM) 03:13:48.034987 --- ParallelTerminationStrategy: PID 18397 died... 03:13:48.055154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18397): Terminated: ok {rc=0} 03:13:48.101367 --- ParallelTerminationStrategy: PID 18400 died... 03:13:48.120902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18400): Terminated: ok {rc=0} 03:13:48.167013 --- ParallelTerminationStrategy: PID 18403 died... 03:13:48.186567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18403): Terminated: ok {rc=0} 03:13:48.274201 bus /gobi_0: Setting Powered False 03:13:49.373606 bus /gobi_0: Setting Powered False 03:13:50.488064 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 sms:nanobts+band-900 --------------------------------------------------------------------- 03:13:51.737089 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:13:51.742493 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:13:51.775113 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:13:51.802073 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 03:13:51.856056 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:13:51.889397 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:13:51.915619 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 03:13:52.458844 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 03:13:52.464002 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:52.474737 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 03:13:52.520901 tst mo_mt_sms.py: using LAC 25594 03:13:52.639786 tst mo_mt_sms.py: using RAC 94 03:13:52.757896 tst mo_mt_sms.py: using CellId 25594 03:13:52.883616 tst mo_mt_sms.py: using BVCI 25595 03:13:52.998485 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:53.009770 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:53.020795 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:53.031761 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:53.042968 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:53.053817 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:13:53.168604 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:13:53.287270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:53.777041 run create_hlr_db(pid=18408): Launched 03:13:53.906302 bus /gobi_6: Setting Powered False 03:13:54.969634 run create_hlr_db(pid=18408): Terminated: ok {rc=0} 03:13:55.395389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Launched 03:13:55.692285 run osmo-hlr_10.42.42.2(pid=18411): Launched 03:13:55.804278 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:56.324512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Launched 03:13:56.618910 run osmo-stp_10.42.42.5(pid=18414): Launched 03:13:56.731202 run osmo-msc_10.42.42.6: Starting osmo-msc 03:13:57.265584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Launched 03:13:57.563735 run osmo-msc_10.42.42.6(pid=18417): Launched 03:13:57.729196 run osmo-stp_10.42.42.5(pid=18414): ERR: Terminated: ERROR {rc=1} [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] 03:13:57.854805 run osmo-stp_10.42.42.5(pid=18414): stdout: | (launched: 2022-12-10_03:13:56.565082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:57.980822 run osmo-stp_10.42.42.5(pid=18414): stderr: | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031356737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:58.104347 run osmo-stp_10.42.42.5(pid=18414): stdout: | (launched: 2022-12-10_03:13:56.565082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:58.221819 run osmo-stp_10.42.42.5(pid=18414): stderr: | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031356736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031356737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031356737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:58.362319 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18414): Process ended prematurely: osmo-stp_10.42.42.5(pid=18414) [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py:16] 03:13:58.370366 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 03:13:58.396419 run osmo-hlr_10.42.42.2(pid=18411): ERR: Terminated: ERROR {rc=237} [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18411)] 03:13:58.444099 run osmo-hlr_10.42.42.2(pid=18411): stdout: | (launched: 2022-12-10_03:13:55.637081) 03:13:58.493223 run osmo-hlr_10.42.42.2(pid=18411): stderr: | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031355812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031355824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031355834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031355835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031355835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:58.562166 run osmo-msc_10.42.42.6(pid=18417): ERR: Terminated: ERROR {rc=2} [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18417)] 03:13:58.610035 run osmo-msc_10.42.42.6(pid=18417): stdout: | (launched: 2022-12-10_03:13:57.508827) 03:13:58.659291 run osmo-msc_10.42.42.6(pid=18417): stderr: | [0;m[38;5;43m20221210031357778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031357778 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc56f67cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031357779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031357779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031357779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031357780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031357783 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031357783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031357784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031357784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:13:58.709169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Terminating (SIGTERM) 03:13:58.749177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Terminating (SIGTERM) 03:13:58.789500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Terminating (SIGTERM) 03:13:58.830010 --- ParallelTerminationStrategy: PID 18410 died... 03:13:58.849191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18410): Terminated: ok {rc=0} 03:13:58.893491 --- ParallelTerminationStrategy: PID 18413 died... 03:13:58.911841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18413): Terminated: ok {rc=0} 03:13:58.956217 --- ParallelTerminationStrategy: PID 18416 died... 03:13:58.974794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18416): Terminated: ok {rc=0} 03:13:59.061674 bus /sierra_3: Setting Powered False 03:14:00.160254 bus /sierra_3: Setting Powered False 03:14:01.286691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:02.543258 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:02.548099 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:02.582407 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 03:14:02.589359 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:02.624671 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:02.657648 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 03:14:02.664508 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:03.184018 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:03.189499 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 03:14:03.200902 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:03.253324 tst assert_extension.py: using LAC 25595 03:14:03.374810 tst assert_extension.py: using RAC 95 03:14:03.490603 tst assert_extension.py: using CellId 25595 03:14:03.605286 tst assert_extension.py: using BVCI 25596 03:14:03.721660 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:03.838493 tst assert_extension.py:10: start nitb and bts... 03:14:04.052038 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:14:04.696820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18423): Launched 03:14:05.013395 run osmo-nitb_10.42.42.2(pid=18424): Launched 03:14:05.189347 run osmo-nitb_10.42.42.2(pid=18424): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18424)] 03:14:05.332623 run osmo-nitb_10.42.42.2(pid=18424): stdout: | (launched: 2022-12-10_03:14:04.955332) 03:14:05.476803 run osmo-nitb_10.42.42.2(pid=18424): stderr: | (launched: 2022-12-10_03:14:05.002826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:05.620654 run osmo-nitb_10.42.42.2(pid=18424): stdout: | (launched: 2022-12-10_03:14:04.955332) 03:14:05.759196 run osmo-nitb_10.42.42.2(pid=18424): stderr: | (launched: 2022-12-10_03:14:05.002826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18424) [trial-2368↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18424)] 03:14:06.132860 tst osmo-nitb_10.42.42.2(pid=18424): stdout: | (launched: 2022-12-10_03:14:04.955332) 03:14:06.260457 tst osmo-nitb_10.42.42.2(pid=18424): stderr: | (launched: 2022-12-10_03:14:05.002826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:06.411161 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18424) [trial-2368↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18424)] [trial-2368↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 03:14:06.419872 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:14:06.426743 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18423): Terminating (SIGTERM) 03:14:06.636922 --- ParallelTerminationStrategy: PID 18423 died... 03:14:06.658174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18423): Terminated: ok {rc=0} 03:14:06.745879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:07.920736 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:07.925383 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:07.957295 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:14:07.983256 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:08.018529 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:08.050593 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:14:08.077118 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:08.605373 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:08.610139 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:08.620682 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:08.669569 tst assert_extension.py: using LAC 25596 03:14:08.793614 tst assert_extension.py: using RAC 96 03:14:08.916444 tst assert_extension.py: using CellId 25596 03:14:09.038803 tst assert_extension.py: using BVCI 25597 03:14:09.155405 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:09.166663 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:09.177608 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:09.188424 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:09.199406 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:09.210230 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:09.324647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:09.782903 run create_hlr_db(pid=18428): Launched 03:14:09.897661 bus /sierra_2: Setting Powered False 03:14:10.957045 run create_hlr_db(pid=18428): Terminated: ok {rc=0} 03:14:11.391878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18430): Launched 03:14:11.709654 run osmo-hlr_10.42.42.2(pid=18431): Launched 03:14:11.831000 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:12.379026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18433): Launched 03:14:12.697066 run osmo-stp_10.42.42.5(pid=18434): Launched 03:14:12.817975 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:13.390093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18436): Launched 03:14:13.707185 run osmo-msc_10.42.42.6(pid=18437): Launched 03:14:13.884876 run osmo-stp_10.42.42.5(pid=18434): ERR: Terminated: ERROR {rc=1} [trial-2368↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18434)] 03:14:14.018985 run osmo-stp_10.42.42.5(pid=18434): stdout: | (launched: 2022-12-10_03:14:12.638302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:14.153757 run osmo-stp_10.42.42.5(pid=18434): stderr: | [0;m[38;5;43m20221210031412828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031412828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031412829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031412829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:14.287499 run osmo-stp_10.42.42.5(pid=18434): stdout: | (launched: 2022-12-10_03:14:12.638302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:14.414024 run osmo-stp_10.42.42.5(pid=18434): stderr: | [0;m[38;5;43m20221210031412828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031412828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031412829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031412829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031412830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:14.565214 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18434): Process ended prematurely: osmo-stp_10.42.42.5(pid=18434) [trial-2368↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18434)] [trial-2368↪ussd:nanobts+band-900↪assert_extension.py:17] 03:14:14.574172 tst assert_extension.py:17: Test FAILED (6.0 sec) 03:14:14.601795 run osmo-hlr_10.42.42.2(pid=18431): ERR: Terminated: ERROR {rc=237} [trial-2368↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18431)] 03:14:14.651618 run osmo-hlr_10.42.42.2(pid=18431): stdout: | (launched: 2022-12-10_03:14:11.651801) 03:14:14.703456 run osmo-hlr_10.42.42.2(pid=18431): stderr: | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031411847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031411859 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031411868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031411868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031411868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:14.775399 run osmo-msc_10.42.42.6(pid=18437): ERR: Terminated: ERROR {rc=2} [trial-2368↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18437)] 03:14:14.825560 run osmo-msc_10.42.42.6(pid=18437): stdout: | (launched: 2022-12-10_03:14:13.649331) 03:14:14.876868 run osmo-msc_10.42.42.6(pid=18437): stderr: | [0;m[38;5;43m20221210031413970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031413970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd471e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031413970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031413970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031413970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031413970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031413972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031413973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031413973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031413973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:14.928556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18430): Terminating (SIGTERM) 03:14:14.970095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18433): Terminating (SIGTERM) 03:14:15.012255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18436): Terminating (SIGTERM) 03:14:15.054696 --- ParallelTerminationStrategy: PID 18430 died... 03:14:15.074726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18430): Terminated: ok {rc=0} 03:14:15.121786 --- ParallelTerminationStrategy: PID 18433 died... 03:14:15.141638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18433): Terminated: ok {rc=0} 03:14:15.188288 --- ParallelTerminationStrategy: PID 18436 died... 03:14:15.208112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18436): Terminated: ok {rc=0} 03:14:15.297364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:14:16.512512 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:16.520344 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:14:16.555054 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:14:16.583696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:14:16.636611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:14:16.694098 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:14:16.727618 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:14:17.263345 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:14:17.314016 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.325180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:14:17.391573 tst mo_mt_call.py: using LAC 25597 03:14:17.511499 tst mo_mt_call.py: using RAC 97 03:14:17.632557 tst mo_mt_call.py: using CellId 25597 03:14:17.754408 tst mo_mt_call.py: using BVCI 25598 03:14:17.864310 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.875487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.886435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.898088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.909803 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:17.921447 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:18.042474 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:18.158880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:18.629674 run create_hlr_db(pid=18442): Launched 03:14:18.746963 bus /sierra_2: Setting Powered False 03:14:19.807070 run create_hlr_db(pid=18442): Terminated: ok {rc=0} 03:14:20.249611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18444): Launched 03:14:20.574136 run osmo-hlr_10.42.42.2(pid=18445): Launched 03:14:20.697829 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:21.258811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18447): Launched 03:14:21.582515 run osmo-stp_10.42.42.5(pid=18448): Launched 03:14:21.706624 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:22.290013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18450): Launched 03:14:22.612715 run osmo-msc_10.42.42.6(pid=18451): Launched 03:14:22.792765 run osmo-stp_10.42.42.5(pid=18448): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18448)] 03:14:22.928222 run osmo-stp_10.42.42.5(pid=18448): stdout: | (launched: 2022-12-10_03:14:21.523360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:23.065605 run osmo-stp_10.42.42.5(pid=18448): stderr: | [0;m[38;5;43m20221210031421716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031421716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031421717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031421717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:23.201699 run osmo-stp_10.42.42.5(pid=18448): stdout: | (launched: 2022-12-10_03:14:21.523360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:23.329557 run osmo-stp_10.42.42.5(pid=18448): stderr: | [0;m[38;5;43m20221210031421716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031421716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031421717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031421717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031421718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:23.483474 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18448): Process ended prematurely: osmo-stp_10.42.42.5(pid=18448) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18448)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:14:23.492744 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:14:23.520645 run osmo-hlr_10.42.42.2(pid=18445): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18445)] 03:14:23.571098 run osmo-hlr_10.42.42.2(pid=18445): stdout: | (launched: 2022-12-10_03:14:20.515244) 03:14:23.622947 run osmo-hlr_10.42.42.2(pid=18445): stderr: | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031420713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031420725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031420733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031420734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031420734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:23.695462 run osmo-msc_10.42.42.6(pid=18451): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18451)] 03:14:23.745620 run osmo-msc_10.42.42.6(pid=18451): stdout: | (launched: 2022-12-10_03:14:22.553830) 03:14:23.797308 run osmo-msc_10.42.42.6(pid=18451): stderr: | [0;m[38;5;43m20221210031422874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031422874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe0685ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031422874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031422874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031422875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031422875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031422876 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031422877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031422877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031422877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:23.849380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18444): Terminating (SIGTERM) 03:14:23.890959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18447): Terminating (SIGTERM) 03:14:23.932643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18450): Terminating (SIGTERM) 03:14:23.974756 --- ParallelTerminationStrategy: PID 18444 died... 03:14:23.994453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18444): Terminated: ok {rc=0} 03:14:24.041002 --- ParallelTerminationStrategy: PID 18447 died... 03:14:24.060573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18447): Terminated: ok {rc=0} 03:14:24.106833 --- ParallelTerminationStrategy: PID 18450 died... 03:14:24.126461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18450): Terminated: ok {rc=0} 03:14:24.214440 bus /sierra_3: Setting Powered False 03:14:25.314442 bus /sierra_3: Setting Powered False 03:14:26.430314 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:14:27.581007 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:27.593435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:14:27.665880 tst mo_mt_call_osmux.py: using LAC 25598 03:14:27.786598 tst mo_mt_call_osmux.py: using RAC 98 03:14:27.906644 tst mo_mt_call_osmux.py: using CellId 25598 03:14:28.027290 tst mo_mt_call_osmux.py: using BVCI 25599 03:14:28.139771 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:28.151114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:28.162319 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:28.174267 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:28.186174 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:28.197845 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:28.319428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:28.435207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:28.905185 run create_hlr_db(pid=18453): Launched 03:14:29.021709 bus /sierra_2: Setting Powered False 03:14:30.083031 run create_hlr_db(pid=18453): Terminated: ok {rc=0} 03:14:30.524365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18455): Launched 03:14:30.856038 run osmo-hlr_10.42.42.2(pid=18456): Launched 03:14:31.065469 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:31.873036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18458): Launched 03:14:32.220260 run osmo-stp_10.42.42.5(pid=18459): Launched 03:14:32.441777 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:32.987387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18461): Launched 03:14:33.289260 run osmo-msc_10.42.42.6(pid=18462): Launched 03:14:33.459730 run osmo-stp_10.42.42.5(pid=18459): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18459)] 03:14:33.587867 run osmo-stp_10.42.42.5(pid=18459): stdout: | (launched: 2022-12-10_03:14:32.153440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:33.716070 run osmo-stp_10.42.42.5(pid=18459): stderr: | [0;m[38;5;43m20221210031432351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031432351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031432352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031432352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:33.842454 run osmo-stp_10.42.42.5(pid=18459): stdout: | (launched: 2022-12-10_03:14:32.153440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:33.962266 run osmo-stp_10.42.42.5(pid=18459): stderr: | [0;m[38;5;43m20221210031432351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031432351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031432352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031432352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031432353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:34.106155 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18459): Process ended prematurely: osmo-stp_10.42.42.5(pid=18459) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18459)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:14:34.115054 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:14:34.141921 run osmo-hlr_10.42.42.2(pid=18456): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18456)] 03:14:34.190261 run osmo-hlr_10.42.42.2(pid=18456): stdout: | (launched: 2022-12-10_03:14:30.788893) 03:14:34.240072 run osmo-hlr_10.42.42.2(pid=18456): stderr: | [0;m[1;31m20221210031431113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031431113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031431113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031431114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031431114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031431114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031431141 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031431157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031431158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031431158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:34.309568 run osmo-msc_10.42.42.6(pid=18462): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18462)] 03:14:34.357542 run osmo-msc_10.42.42.6(pid=18462): stdout: | (launched: 2022-12-10_03:14:33.233618) 03:14:34.407291 run osmo-msc_10.42.42.6(pid=18462): stderr: | [0;m[38;5;43m20221210031433508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031433508 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb28368ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031433508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031433508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031433508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031433508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031433511 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031433511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031433511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031433512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:34.457477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18455): Terminating (SIGTERM) 03:14:34.497882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18458): Terminating (SIGTERM) 03:14:34.538047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18461): Terminating (SIGTERM) 03:14:34.578563 --- ParallelTerminationStrategy: PID 18455 died... 03:14:34.597783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18455): Terminated: ok {rc=0} 03:14:34.642545 --- ParallelTerminationStrategy: PID 18458 died... 03:14:34.661432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18458): Terminated: ok {rc=0} 03:14:34.705997 --- ParallelTerminationStrategy: PID 18461 died... 03:14:34.724880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18461): Terminated: ok {rc=0} 03:14:34.811235 bus /sierra_3: Setting Powered False 03:14:35.911581 bus /sierra_3: Setting Powered False 03:14:37.024843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:14:38.280093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:38.288649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:14:38.322316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:14:38.348862 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:14:38.404194 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:14:38.438058 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:14:38.465319 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:14:39.009775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:14:39.059198 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.070454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:14:39.137387 tst mo_mt_call.py: using LAC 25599 03:14:39.258402 tst mo_mt_call.py: using RAC 99 03:14:39.378314 tst mo_mt_call.py: using CellId 25599 03:14:39.498468 tst mo_mt_call.py: using BVCI 25600 03:14:39.609555 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.620610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.631561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.642743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.653945 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:39.665081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:39.785518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:39.906326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:40.406308 run create_hlr_db(pid=18467): Launched 03:14:40.537623 bus /sierra_2: Setting Powered False 03:14:41.601472 run create_hlr_db(pid=18467): Terminated: ok {rc=0} 03:14:42.030866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18469): Launched 03:14:42.333891 run osmo-hlr_10.42.42.2(pid=18470): Launched 03:14:42.448858 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:42.983732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18472): Launched 03:14:43.286835 run osmo-stp_10.42.42.5(pid=18473): Launched 03:14:43.402981 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:43.946851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18475): Launched 03:14:44.248651 run osmo-msc_10.42.42.6(pid=18476): Launched 03:14:44.418861 run osmo-stp_10.42.42.5(pid=18473): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18473)] 03:14:44.547447 run osmo-stp_10.42.42.5(pid=18473): stdout: | (launched: 2022-12-10_03:14:43.231391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:44.676544 run osmo-stp_10.42.42.5(pid=18473): stderr: | [0;m[38;5;43m20221210031443402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031443403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031443403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031443403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:44.803630 run osmo-stp_10.42.42.5(pid=18473): stdout: | (launched: 2022-12-10_03:14:43.231391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:44.923690 run osmo-stp_10.42.42.5(pid=18473): stderr: | [0;m[38;5;43m20221210031443402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031443403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031443403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031443403 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031443404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:45.067461 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18473): Process ended prematurely: osmo-stp_10.42.42.5(pid=18473) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18473)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:14:45.076479 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:14:45.103907 run osmo-hlr_10.42.42.2(pid=18470): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18470)] 03:14:45.152077 run osmo-hlr_10.42.42.2(pid=18470): stdout: | (launched: 2022-12-10_03:14:42.278641) 03:14:45.201988 run osmo-hlr_10.42.42.2(pid=18470): stderr: | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031442455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031442467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031442476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031442476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031442476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:45.271257 run osmo-msc_10.42.42.6(pid=18476): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18476)] 03:14:45.319244 run osmo-msc_10.42.42.6(pid=18476): stdout: | (launched: 2022-12-10_03:14:44.193435) 03:14:45.369149 run osmo-msc_10.42.42.6(pid=18476): stderr: | [0;m[38;5;43m20221210031444465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031444465 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b771b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031444466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031444466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031444466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031444466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031444468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031444468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031444468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031444468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:45.419268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18469): Terminating (SIGTERM) 03:14:45.459719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18472): Terminating (SIGTERM) 03:14:45.500116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18475): Terminating (SIGTERM) 03:14:45.541142 --- ParallelTerminationStrategy: PID 18469 died... 03:14:45.560332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18469): Terminated: ok {rc=0} 03:14:45.604455 --- ParallelTerminationStrategy: PID 18472 died... 03:14:45.623114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18472): Terminated: ok {rc=0} 03:14:45.667186 --- ParallelTerminationStrategy: PID 18475 died... 03:14:45.685859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18475): Terminated: ok {rc=0} 03:14:45.769388 bus /sierra_3: Setting Powered False 03:14:46.864112 bus /sierra_3: Setting Powered False 03:14:47.978971 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:14:49.122228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.133967 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:14:49.204869 tst mo_mt_call_osmux.py: using LAC 25600 03:14:49.323283 tst mo_mt_call_osmux.py: using RAC 100 03:14:49.440543 tst mo_mt_call_osmux.py: using CellId 25600 03:14:49.557381 tst mo_mt_call_osmux.py: using BVCI 25601 03:14:49.675316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.687068 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.698706 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.710215 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.721966 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:49.733542 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:49.848121 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:49.967355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:50.469383 run create_hlr_db(pid=18478): Launched 03:14:50.602326 bus /sierra_2: Setting Powered False 03:14:51.665710 run create_hlr_db(pid=18478): Terminated: ok {rc=0} 03:14:52.096050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18481): Launched 03:14:52.421124 run osmo-hlr_10.42.42.2(pid=18482): Launched 03:14:52.545355 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:53.104637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18484): Launched 03:14:53.427155 run osmo-stp_10.42.42.5(pid=18485): Launched 03:14:53.550301 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:54.133217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18487): Launched 03:14:54.455939 run osmo-msc_10.42.42.6(pid=18488): Launched 03:14:54.635818 run osmo-stp_10.42.42.5(pid=18485): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18485)] 03:14:54.771765 run osmo-stp_10.42.42.5(pid=18485): stdout: | (launched: 2022-12-10_03:14:53.368278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:54.908016 run osmo-stp_10.42.42.5(pid=18485): stderr: | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031453562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:55.043956 run osmo-stp_10.42.42.5(pid=18485): stdout: | (launched: 2022-12-10_03:14:53.368278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:55.171926 run osmo-stp_10.42.42.5(pid=18485): stderr: | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031453561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031453562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031453562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:55.324900 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18485): Process ended prematurely: osmo-stp_10.42.42.5(pid=18485) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18485)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:14:55.334365 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:14:55.362183 run osmo-hlr_10.42.42.2(pid=18482): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18482)] 03:14:55.412221 run osmo-hlr_10.42.42.2(pid=18482): stdout: | (launched: 2022-12-10_03:14:52.362074) 03:14:55.463848 run osmo-hlr_10.42.42.2(pid=18482): stderr: | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031452565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031452579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031452587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031452587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031452587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:55.536096 run osmo-msc_10.42.42.6(pid=18488): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18488)] 03:14:55.586018 run osmo-msc_10.42.42.6(pid=18488): stdout: | (launched: 2022-12-10_03:14:54.396683) 03:14:55.638014 run osmo-msc_10.42.42.6(pid=18488): stderr: | [0;m[38;5;43m20221210031454720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031454720 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50f72dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031454720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031454720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031454720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031454720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031454722 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031454722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031454723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031454723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:55.689852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18481): Terminating (SIGTERM) 03:14:55.731315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18484): Terminating (SIGTERM) 03:14:55.772696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18487): Terminating (SIGTERM) 03:14:55.814721 --- ParallelTerminationStrategy: PID 18481 died... 03:14:55.834766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18481): Terminated: ok {rc=0} 03:14:55.880820 --- ParallelTerminationStrategy: PID 18484 died... 03:14:55.900569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18484): Terminated: ok {rc=0} 03:14:55.946414 --- ParallelTerminationStrategy: PID 18487 died... 03:14:55.966044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18487): Terminated: ok {rc=0} 03:14:56.053973 bus /sierra_3: Setting Powered False 03:14:57.153768 bus /sierra_3: Setting Powered False 03:14:58.271966 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:14:59.518147 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:59.527217 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:14:59.559725 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:14:59.586993 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:14:59.640234 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:14:59.672038 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:14:59.698518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:15:00.253388 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:15:00.306511 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.318050 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:00.386879 tst mo_mt_call.py: using LAC 25601 03:15:00.514979 tst mo_mt_call.py: using RAC 101 03:15:00.647089 tst mo_mt_call.py: using CellId 25601 03:15:00.773401 tst mo_mt_call.py: using BVCI 25602 03:15:00.903032 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.916512 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.928585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.942952 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.955769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:00.968936 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:01.106095 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:01.256454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:01.782051 run create_hlr_db(pid=18493): Launched 03:15:01.949678 bus /sierra_2: Setting Powered False 03:15:03.009957 run create_hlr_db(pid=18493): Terminated: ok {rc=0} 03:15:03.453835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18498): Launched 03:15:03.776038 run osmo-hlr_10.42.42.2(pid=18499): Launched 03:15:03.898848 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:04.452399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18501): Launched 03:15:04.773182 run osmo-stp_10.42.42.5(pid=18502): Launched 03:15:04.895457 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:05.479256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18504): Launched 03:15:05.803332 run osmo-msc_10.42.42.6(pid=18505): Launched 03:15:05.982952 run osmo-stp_10.42.42.5(pid=18502): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] 03:15:06.119706 run osmo-stp_10.42.42.5(pid=18502): stdout: | (launched: 2022-12-10_03:15:04.714487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:06.256472 run osmo-stp_10.42.42.5(pid=18502): stderr: | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031504908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:06.392058 run osmo-stp_10.42.42.5(pid=18502): stdout: | (launched: 2022-12-10_03:15:04.714487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:06.520000 run osmo-stp_10.42.42.5(pid=18502): stderr: | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031504907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031504908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031504908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:06.673354 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18502): Process ended prematurely: osmo-stp_10.42.42.5(pid=18502) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:15:06.682633 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:15:06.710463 run osmo-hlr_10.42.42.2(pid=18499): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18499)] 03:15:06.760624 run osmo-hlr_10.42.42.2(pid=18499): stdout: | (launched: 2022-12-10_03:15:03.717554) 03:15:06.812217 run osmo-hlr_10.42.42.2(pid=18499): stderr: | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031503915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031503929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031503937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031503937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031503937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:06.884484 run osmo-msc_10.42.42.6(pid=18505): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18505)] 03:15:06.934617 run osmo-msc_10.42.42.6(pid=18505): stdout: | (launched: 2022-12-10_03:15:05.744113) 03:15:06.986437 run osmo-msc_10.42.42.6(pid=18505): stderr: | [0;m[38;5;43m20221210031506065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031506065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff386e19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031506065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031506065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031506066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031506066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031506067 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031506068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031506068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031506068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:07.038900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18498): Terminating (SIGTERM) 03:15:07.080522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18501): Terminating (SIGTERM) 03:15:07.122049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18504): Terminating (SIGTERM) 03:15:07.163941 --- ParallelTerminationStrategy: PID 18498 died... 03:15:07.183983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18498): Terminated: ok {rc=0} 03:15:07.230206 --- ParallelTerminationStrategy: PID 18501 died... 03:15:07.249541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18501): Terminated: ok {rc=0} 03:15:07.295549 --- ParallelTerminationStrategy: PID 18504 died... 03:15:07.315218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18504): Terminated: ok {rc=0} 03:15:07.402608 bus /sierra_3: Setting Powered False 03:15:08.502407 bus /sierra_3: Setting Powered False 03:15:09.619912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:15:10.765613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:10.777380 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:10.844860 tst mo_mt_call_osmux.py: using LAC 25602 03:15:10.964753 tst mo_mt_call_osmux.py: using RAC 102 03:15:11.083232 tst mo_mt_call_osmux.py: using CellId 25602 03:15:11.203154 tst mo_mt_call_osmux.py: using BVCI 25603 03:15:11.314044 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:11.325274 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:11.336206 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:11.347473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:11.358816 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:11.370084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:11.484774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:11.608777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:12.079377 run create_hlr_db(pid=18507): Launched 03:15:12.195325 bus /sierra_2: Setting Powered False 03:15:13.255538 run create_hlr_db(pid=18507): Terminated: ok {rc=0} 03:15:13.698339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18509): Launched 03:15:14.024413 run osmo-hlr_10.42.42.2(pid=18510): Launched 03:15:14.149691 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:14.705851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18512): Launched 03:15:15.028878 run osmo-stp_10.42.42.5(pid=18513): Launched 03:15:15.153262 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:15.737656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18515): Launched 03:15:16.083176 run osmo-msc_10.42.42.6(pid=18516): Launched 03:15:16.307269 run osmo-stp_10.42.42.5(pid=18513): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18513)] 03:15:16.490227 run osmo-stp_10.42.42.5(pid=18513): stdout: | (launched: 2022-12-10_03:15:14.970104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:16.741428 run osmo-stp_10.42.42.5(pid=18513): stderr: | [0;m[38;5;43m20221210031515164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031515164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031515165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031515165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:16.911335 run osmo-stp_10.42.42.5(pid=18513): stdout: | (launched: 2022-12-10_03:15:14.970104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:17.100037 run osmo-stp_10.42.42.5(pid=18513): stderr: | [0;m[38;5;43m20221210031515164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031515164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031515165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031515165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031515166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:17.250189 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18513): Process ended prematurely: osmo-stp_10.42.42.5(pid=18513) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18513)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:15:17.259736 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:15:17.289175 run osmo-hlr_10.42.42.2(pid=18510): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18510)] 03:15:17.341131 run osmo-hlr_10.42.42.2(pid=18510): stdout: | (launched: 2022-12-10_03:15:13.965281) 03:15:17.393805 run osmo-hlr_10.42.42.2(pid=18510): stderr: | [0;m[1;31m20221210031514163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031514163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031514163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031514164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031514164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031514164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031514176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031514184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031514185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031514185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:17.465861 run osmo-msc_10.42.42.6(pid=18516): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18516)] 03:15:17.518155 run osmo-msc_10.42.42.6(pid=18516): stdout: | (launched: 2022-12-10_03:15:16.021763) 03:15:17.569305 run osmo-msc_10.42.42.6(pid=18516): stderr: | [0;m[38;5;43m20221210031516599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031516599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54f7bdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031516599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031516599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031516600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031516600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031516602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031516602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031516602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031516602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:17.620420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18509): Terminating (SIGTERM) 03:15:17.661209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18512): Terminating (SIGTERM) 03:15:17.701937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18515): Terminating (SIGTERM) 03:15:17.743118 --- ParallelTerminationStrategy: PID 18509 died... 03:15:17.762087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18509): Terminated: ok {rc=0} 03:15:17.808188 --- ParallelTerminationStrategy: PID 18512 died... 03:15:17.826905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18512): Terminated: ok {rc=0} 03:15:17.871348 --- ParallelTerminationStrategy: PID 18515 died... 03:15:17.890067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18515): Terminated: ok {rc=0} 03:15:17.976630 bus /sierra_3: Setting Powered False 03:15:19.075495 bus /sierra_3: Setting Powered False 03:15:20.190223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:15:21.444610 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:21.452531 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:15:21.485427 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:15:21.512547 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:15:21.564870 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:15:21.598088 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:15:21.625536 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:15:22.178814 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:15:22.230751 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.242587 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:15:22.314487 tst mo_mt_call.py: using LAC 25603 03:15:22.455123 tst mo_mt_call.py: using RAC 103 03:15:22.584058 tst mo_mt_call.py: using CellId 25603 03:15:22.710958 tst mo_mt_call.py: using BVCI 25604 03:15:22.829950 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.841632 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.852934 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.864515 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.876214 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:22.887794 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:23.008586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:23.124406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:23.626393 run create_hlr_db(pid=18521): Launched 03:15:23.758110 bus /sierra_2: Setting Powered False 03:15:24.821304 run create_hlr_db(pid=18521): Terminated: ok {rc=0} 03:15:25.251542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18523): Launched 03:15:25.554840 run osmo-hlr_10.42.42.2(pid=18524): Launched 03:15:25.670888 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:26.203251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18526): Launched 03:15:26.504695 run osmo-stp_10.42.42.5(pid=18527): Launched 03:15:26.619980 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:27.165153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18529): Launched 03:15:27.466395 run osmo-msc_10.42.42.6(pid=18530): Launched 03:15:27.636713 run osmo-stp_10.42.42.5(pid=18527): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18527)] 03:15:27.765536 run osmo-stp_10.42.42.5(pid=18527): stdout: | (launched: 2022-12-10_03:15:26.449430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:27.894060 run osmo-stp_10.42.42.5(pid=18527): stderr: | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031526620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:28.020190 run osmo-stp_10.42.42.5(pid=18527): stdout: | (launched: 2022-12-10_03:15:26.449430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:28.139656 run osmo-stp_10.42.42.5(pid=18527): stderr: | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031526619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031526620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031526620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:28.282556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18527): Process ended prematurely: osmo-stp_10.42.42.5(pid=18527) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18527)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:15:28.291194 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:15:28.318180 run osmo-hlr_10.42.42.2(pid=18524): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18524)] 03:15:28.365871 run osmo-hlr_10.42.42.2(pid=18524): stdout: | (launched: 2022-12-10_03:15:25.499525) 03:15:28.415565 run osmo-hlr_10.42.42.2(pid=18524): stderr: | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031525673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031525685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031525695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031525695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031525695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:28.484871 run osmo-msc_10.42.42.6(pid=18530): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18530)] 03:15:28.532850 run osmo-msc_10.42.42.6(pid=18530): stdout: | (launched: 2022-12-10_03:15:27.410956) 03:15:28.582439 run osmo-msc_10.42.42.6(pid=18530): stderr: | [0;m[38;5;43m20221210031527680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031527680 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb186ffec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031527680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031527680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031527680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031527681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031527682 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031527683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031527683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031527683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:28.632312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18523): Terminating (SIGTERM) 03:15:28.672086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18526): Terminating (SIGTERM) 03:15:28.711941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18529): Terminating (SIGTERM) 03:15:28.752258 --- ParallelTerminationStrategy: PID 18523 died... 03:15:28.771479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18523): Terminated: ok {rc=0} 03:15:28.815940 --- ParallelTerminationStrategy: PID 18526 died... 03:15:28.834728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18526): Terminated: ok {rc=0} 03:15:28.878735 --- ParallelTerminationStrategy: PID 18529 died... 03:15:28.897395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18529): Terminated: ok {rc=0} 03:15:28.983516 bus /sierra_3: Setting Powered False 03:15:30.084277 bus /sierra_3: Setting Powered False 03:15:31.199845 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:15:32.350582 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.362714 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:15:32.431379 tst mo_mt_call_osmux.py: using LAC 25604 03:15:32.558578 tst mo_mt_call_osmux.py: using RAC 104 03:15:32.686510 tst mo_mt_call_osmux.py: using CellId 25604 03:15:32.815049 tst mo_mt_call_osmux.py: using BVCI 25605 03:15:32.933460 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.945058 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.956552 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.968053 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.979651 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:32.991028 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:33.111721 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:33.227247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:33.697298 run create_hlr_db(pid=18532): Launched 03:15:33.830758 bus /sierra_2: Setting Powered False 03:15:34.894788 run create_hlr_db(pid=18532): Terminated: ok {rc=0} 03:15:35.324535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18534): Launched 03:15:35.627426 run osmo-hlr_10.42.42.2(pid=18535): Launched 03:15:35.744024 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:36.269726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18537): Launched 03:15:36.593647 run osmo-stp_10.42.42.5(pid=18538): Launched 03:15:36.717061 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:37.302862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18540): Launched 03:15:37.626205 run osmo-msc_10.42.42.6(pid=18541): Launched 03:15:37.805822 run osmo-stp_10.42.42.5(pid=18538): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18538)] 03:15:37.942610 run osmo-stp_10.42.42.5(pid=18538): stdout: | (launched: 2022-12-10_03:15:36.534874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:38.080247 run osmo-stp_10.42.42.5(pid=18538): stderr: | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031536729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:38.215878 run osmo-stp_10.42.42.5(pid=18538): stdout: | (launched: 2022-12-10_03:15:36.534874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:38.344189 run osmo-stp_10.42.42.5(pid=18538): stderr: | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031536728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031536729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031536729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:38.497613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18538): Process ended prematurely: osmo-stp_10.42.42.5(pid=18538) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18538)] [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:15:38.507080 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:15:38.534651 run osmo-hlr_10.42.42.2(pid=18535): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18535)] 03:15:38.584193 run osmo-hlr_10.42.42.2(pid=18535): stdout: | (launched: 2022-12-10_03:15:35.571857) 03:15:38.635470 run osmo-hlr_10.42.42.2(pid=18535): stderr: | [0;m[1;31m20221210031535748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031535748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031535748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031535748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031535749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031535749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031535760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031535770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031535770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031535770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:38.707345 run osmo-msc_10.42.42.6(pid=18541): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18541)] 03:15:38.756865 run osmo-msc_10.42.42.6(pid=18541): stdout: | (launched: 2022-12-10_03:15:37.567180) 03:15:38.808050 run osmo-msc_10.42.42.6(pid=18541): stderr: | [0;m[38;5;43m20221210031537888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031537888 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41a77eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031537888 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031537888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031537888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031537888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031537890 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031537890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031537890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031537891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:38.859637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18534): Terminating (SIGTERM) 03:15:38.901060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18537): Terminating (SIGTERM) 03:15:38.942448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18540): Terminating (SIGTERM) 03:15:38.984228 --- ParallelTerminationStrategy: PID 18534 died... 03:15:39.004187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18534): Terminated: ok {rc=0} 03:15:39.050341 --- ParallelTerminationStrategy: PID 18537 died... 03:15:39.069673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18537): Terminated: ok {rc=0} 03:15:39.116112 --- ParallelTerminationStrategy: PID 18540 died... 03:15:39.135612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18540): Terminated: ok {rc=0} 03:15:39.222811 bus /sierra_3: Setting Powered False 03:15:40.322384 bus /sierra_3: Setting Powered False 03:15:41.438144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:15:42.690540 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:42.698236 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:15:42.731051 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:15:42.758306 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:15:42.811024 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:15:42.843810 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:15:42.870932 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:15:43.428299 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:15:43.481299 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:43.492876 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:15:43.565542 tst mo_mt_call.py: using LAC 25605 03:15:43.691204 tst mo_mt_call.py: using RAC 105 03:15:43.816193 tst mo_mt_call.py: using CellId 25605 03:15:43.934701 tst mo_mt_call.py: using BVCI 25606 03:15:44.045177 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:44.056402 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:44.067676 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:44.079099 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:44.090463 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:44.101718 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:44.220325 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:44.344663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:44.846624 run create_hlr_db(pid=18546): Launched 03:15:44.978893 bus /sierra_2: Setting Powered False 03:15:46.042024 run create_hlr_db(pid=18546): Terminated: ok {rc=0} 03:15:46.562900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18548): Launched 03:15:46.886656 run osmo-hlr_10.42.42.2(pid=18549): Launched 03:15:47.120338 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:47.702703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18551): Launched 03:15:48.025720 run osmo-stp_10.42.42.5(pid=18552): Launched 03:15:48.149924 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:48.735456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18554): Launched 03:15:49.058898 run osmo-msc_10.42.42.6(pid=18555): Launched 03:15:49.239914 run osmo-stp_10.42.42.5(pid=18552): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18552)] 03:15:49.376009 run osmo-stp_10.42.42.5(pid=18552): stdout: | (launched: 2022-12-10_03:15:47.966139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:49.513497 run osmo-stp_10.42.42.5(pid=18552): stderr: | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031548161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:49.649265 run osmo-stp_10.42.42.5(pid=18552): stdout: | (launched: 2022-12-10_03:15:47.966139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:49.776916 run osmo-stp_10.42.42.5(pid=18552): stderr: | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031548160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031548161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031548161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:49.929938 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18552): Process ended prematurely: osmo-stp_10.42.42.5(pid=18552) [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18552)] [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:15:49.939310 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:15:49.966938 run osmo-hlr_10.42.42.2(pid=18549): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18549)] 03:15:50.017096 run osmo-hlr_10.42.42.2(pid=18549): stdout: | (launched: 2022-12-10_03:15:46.824442) 03:15:50.069665 run osmo-hlr_10.42.42.2(pid=18549): stderr: | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031547176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031547189 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031547199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031547199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031547200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:50.142552 run osmo-msc_10.42.42.6(pid=18555): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18555)] 03:15:50.192854 run osmo-msc_10.42.42.6(pid=18555): stdout: | (launched: 2022-12-10_03:15:48.999525) 03:15:50.244472 run osmo-msc_10.42.42.6(pid=18555): stderr: | [0;m[38;5;43m20221210031549322 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031549322 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44a3cb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031549322 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031549322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031549322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031549322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031549324 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031549324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031549325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031549325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:50.296457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18548): Terminating (SIGTERM) 03:15:50.338911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18551): Terminating (SIGTERM) 03:15:50.380592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18554): Terminating (SIGTERM) 03:15:50.422750 --- ParallelTerminationStrategy: PID 18548 died... 03:15:50.442733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18548): Terminated: ok {rc=0} 03:15:50.489046 --- ParallelTerminationStrategy: PID 18551 died... 03:15:50.508590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18551): Terminated: ok {rc=0} 03:15:50.554615 --- ParallelTerminationStrategy: PID 18554 died... 03:15:50.574218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18554): Terminated: ok {rc=0} 03:15:50.662446 bus /sierra_3: Setting Powered False 03:15:51.763426 bus /sierra_3: Setting Powered False 03:15:52.881110 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:15:54.030369 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.042739 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:15:54.116399 tst mo_mt_call_osmux.py: using LAC 25606 03:15:54.235168 tst mo_mt_call_osmux.py: using RAC 106 03:15:54.352332 tst mo_mt_call_osmux.py: using CellId 25606 03:15:54.469376 tst mo_mt_call_osmux.py: using BVCI 25607 03:15:54.579148 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.590503 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.601820 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.613083 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.624263 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:54.635483 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:54.754710 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:54.871446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:55.339625 run create_hlr_db(pid=18557): Launched 03:15:55.454503 bus /sierra_2: Setting Powered False 03:15:56.515014 run create_hlr_db(pid=18557): Terminated: ok {rc=0} 03:15:56.935505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18559): Launched 03:15:57.237423 run osmo-hlr_10.42.42.2(pid=18560): Launched 03:15:57.353827 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:57.887806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18562): Launched 03:15:58.190191 run osmo-stp_10.42.42.5(pid=18563): Launched 03:15:58.306860 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:58.852612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18565): Launched 03:15:59.155271 run osmo-msc_10.42.42.6(pid=18566): Launched 03:15:59.325441 run osmo-stp_10.42.42.5(pid=18563): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] 03:15:59.453460 run osmo-stp_10.42.42.5(pid=18563): stdout: | (launched: 2022-12-10_03:15:58.134821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:59.581794 run osmo-stp_10.42.42.5(pid=18563): stderr: | [0;m[38;5;43m20221210031558304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031558304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031558305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031558306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:59.708493 run osmo-stp_10.42.42.5(pid=18563): stdout: | (launched: 2022-12-10_03:15:58.134821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:59.828200 run osmo-stp_10.42.42.5(pid=18563): stderr: | [0;m[38;5;43m20221210031558304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031558304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031558305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031558306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031558306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:59.971437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18563): Process ended prematurely: osmo-stp_10.42.42.5(pid=18563) [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:15:59.980302 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:16:00.007214 run osmo-hlr_10.42.42.2(pid=18560): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18560)] 03:16:00.055733 run osmo-hlr_10.42.42.2(pid=18560): stdout: | (launched: 2022-12-10_03:15:57.181987) 03:16:00.105636 run osmo-hlr_10.42.42.2(pid=18560): stderr: | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031557357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031557370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031557378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031557378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031557379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:00.175271 run osmo-msc_10.42.42.6(pid=18566): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18566)] 03:16:00.223317 run osmo-msc_10.42.42.6(pid=18566): stdout: | (launched: 2022-12-10_03:15:59.099769) 03:16:00.273433 run osmo-msc_10.42.42.6(pid=18566): stderr: | [0;m[38;5;43m20221210031559369 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031559370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc4f64dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031559370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031559370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031559370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031559370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031559372 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031559372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031559372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031559372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:00.323745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18559): Terminating (SIGTERM) 03:16:00.363705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18562): Terminating (SIGTERM) 03:16:00.403668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18565): Terminating (SIGTERM) 03:16:00.444276 --- ParallelTerminationStrategy: PID 18559 died... 03:16:00.463374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18559): Terminated: ok {rc=0} 03:16:00.508561 --- ParallelTerminationStrategy: PID 18562 died... 03:16:00.527556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18562): Terminated: ok {rc=0} 03:16:00.572083 --- ParallelTerminationStrategy: PID 18565 died... 03:16:00.591131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18565): Terminated: ok {rc=0} 03:16:00.678390 bus /sierra_3: Setting Powered False 03:16:01.775242 bus /sierra_3: Setting Powered False 03:16:02.889423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:16:04.149078 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:04.156608 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:16:04.189683 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:16:04.216807 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:16:04.268135 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:16:04.301018 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:16:04.328154 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:16:04.884896 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:16:04.936353 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:04.948144 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:04.997895 tst mo_mt_call.py: using LAC 25607 03:16:05.123052 tst mo_mt_call.py: using RAC 107 03:16:05.249615 tst mo_mt_call.py: using CellId 25607 03:16:05.374954 tst mo_mt_call.py: using BVCI 25608 03:16:05.493549 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:05.505731 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:05.517425 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:05.528879 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:05.540573 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:05.552162 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:05.667667 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:05.786365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:06.288325 run create_hlr_db(pid=18571): Launched 03:16:06.419607 bus /sierra_2: Setting Powered False 03:16:07.484242 run create_hlr_db(pid=18571): Terminated: ok {rc=0} 03:16:07.916116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18573): Launched 03:16:08.219333 run osmo-hlr_10.42.42.2(pid=18574): Launched 03:16:08.334768 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:08.856797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18576): Launched 03:16:09.159510 run osmo-stp_10.42.42.5(pid=18577): Launched 03:16:09.274868 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:09.819157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18579): Launched 03:16:10.121487 run osmo-msc_10.42.42.6(pid=18580): Launched 03:16:10.291857 run osmo-stp_10.42.42.5(pid=18577): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18577)] 03:16:10.421363 run osmo-stp_10.42.42.5(pid=18577): stdout: | (launched: 2022-12-10_03:16:09.104066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:10.550572 run osmo-stp_10.42.42.5(pid=18577): stderr: | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031609273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:10.677452 run osmo-stp_10.42.42.5(pid=18577): stdout: | (launched: 2022-12-10_03:16:09.104066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:10.797673 run osmo-stp_10.42.42.5(pid=18577): stderr: | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031609272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031609273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031609275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:10.941846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18577): Process ended prematurely: osmo-stp_10.42.42.5(pid=18577) [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18577)] [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:16:10.950668 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:16:10.977567 run osmo-hlr_10.42.42.2(pid=18574): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18574)] 03:16:11.026131 run osmo-hlr_10.42.42.2(pid=18574): stdout: | (launched: 2022-12-10_03:16:08.163265) 03:16:11.076110 run osmo-hlr_10.42.42.2(pid=18574): stderr: | [0;m[1;31m20221210031608340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031608341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031608341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031608341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031608341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031608341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031608352 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031608362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031608362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031608362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:11.145873 run osmo-msc_10.42.42.6(pid=18580): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18580)] 03:16:11.193843 run osmo-msc_10.42.42.6(pid=18580): stdout: | (launched: 2022-12-10_03:16:10.065690) 03:16:11.243502 run osmo-msc_10.42.42.6(pid=18580): stderr: | [0;m[38;5;43m20221210031610337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031610337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf4edecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031610337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031610337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031610337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031610338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031610339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031610340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031610340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031610340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:11.293842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18573): Terminating (SIGTERM) 03:16:11.334061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18576): Terminating (SIGTERM) 03:16:11.374390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18579): Terminating (SIGTERM) 03:16:11.414955 --- ParallelTerminationStrategy: PID 18573 died... 03:16:11.434269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18573): Terminated: ok {rc=0} 03:16:11.479260 --- ParallelTerminationStrategy: PID 18576 died... 03:16:11.498226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18576): Terminated: ok {rc=0} 03:16:11.542972 --- ParallelTerminationStrategy: PID 18579 died... 03:16:11.561848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18579): Terminated: ok {rc=0} 03:16:11.648549 bus /sierra_3: Setting Powered False 03:16:12.747494 bus /sierra_3: Setting Powered False 03:16:13.864264 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:16:15.009100 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.021155 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:15.069706 tst mo_mt_call_osmux.py: using LAC 25608 03:16:15.190548 tst mo_mt_call_osmux.py: using RAC 108 03:16:15.317511 tst mo_mt_call_osmux.py: using CellId 25608 03:16:15.442956 tst mo_mt_call_osmux.py: using BVCI 25609 03:16:15.561917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.573749 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.585552 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.597175 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.608846 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:15.620438 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:15.736151 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:15.857456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:16.362489 run create_hlr_db(pid=18582): Launched 03:16:16.518708 bus /sierra_2: Setting Powered False 03:16:17.583140 run create_hlr_db(pid=18582): Terminated: ok {rc=0} 03:16:18.015554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18584): Launched 03:16:18.320510 run osmo-hlr_10.42.42.2(pid=18585): Launched 03:16:18.436819 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:18.958077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18587): Launched 03:16:19.261600 run osmo-stp_10.42.42.5(pid=18588): Launched 03:16:19.378293 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:19.935123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18590): Launched 03:16:20.237979 run osmo-msc_10.42.42.6(pid=18591): Launched 03:16:20.408611 run osmo-stp_10.42.42.5(pid=18588): ERR: Terminated: ERROR {rc=1} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18588)] 03:16:20.536921 run osmo-stp_10.42.42.5(pid=18588): stdout: | (launched: 2022-12-10_03:16:19.205792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:20.665835 run osmo-stp_10.42.42.5(pid=18588): stderr: | [0;m[38;5;43m20221210031619378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031619378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031619379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031619379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031619379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031619380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031619380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:20.792620 run osmo-stp_10.42.42.5(pid=18588): stdout: | (launched: 2022-12-10_03:16:19.205792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:20.912449 run osmo-stp_10.42.42.5(pid=18588): stderr: | [0;m[38;5;43m20221210031619378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031619378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031619379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031619379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031619379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031619380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031619380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:21.056743 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18588): Process ended prematurely: osmo-stp_10.42.42.5(pid=18588) [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18588)] [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:16:21.065874 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:16:21.093289 run osmo-hlr_10.42.42.2(pid=18585): ERR: Terminated: ERROR {rc=237} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18585)] 03:16:21.141563 run osmo-hlr_10.42.42.2(pid=18585): stdout: | (launched: 2022-12-10_03:16:18.264466) 03:16:21.191355 run osmo-hlr_10.42.42.2(pid=18585): stderr: | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031618442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031618469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031618479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031618479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031618479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:21.261268 run osmo-msc_10.42.42.6(pid=18591): ERR: Terminated: ERROR {rc=2} [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18591)] 03:16:21.309108 run osmo-msc_10.42.42.6(pid=18591): stdout: | (launched: 2022-12-10_03:16:20.181956) 03:16:21.358978 run osmo-msc_10.42.42.6(pid=18591): stderr: | [0;m[38;5;43m20221210031620453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031620453 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc77e7ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031620453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031620453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031620453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031620454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031620456 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031620456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031620456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031620456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:21.409194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18584): Terminating (SIGTERM) 03:16:21.449757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18587): Terminating (SIGTERM) 03:16:21.489839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18590): Terminating (SIGTERM) 03:16:21.530098 --- ParallelTerminationStrategy: PID 18584 died... 03:16:21.549355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18584): Terminated: ok {rc=0} 03:16:21.594077 --- ParallelTerminationStrategy: PID 18587 died... 03:16:21.612873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18587): Terminated: ok {rc=0} 03:16:21.657556 --- ParallelTerminationStrategy: PID 18590 died... 03:16:21.676289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18590): Terminated: ok {rc=0} 03:16:21.763224 bus /sierra_3: Setting Powered False 03:16:22.861630 bus /sierra_3: Setting Powered False 03:16:23.977184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 emergency:nanobts+band-900 --------------------------------------------------------------------- 03:16:25.237894 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:25.243391 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:16:25.276192 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:16:25.303077 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:16:25.389844 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:16:25.422690 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:16:25.449828 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:16:26.035003 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2368 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 03:16:26.040084 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.051119 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:26.103037 tst emergency_mo_mt_call.py: using LAC 25609 03:16:26.225569 tst emergency_mo_mt_call.py: using RAC 109 03:16:26.348431 tst emergency_mo_mt_call.py: using CellId 25609 03:16:26.471863 tst emergency_mo_mt_call.py: using BVCI 25610 03:16:26.586438 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.597650 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.608521 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.619503 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.630473 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:26.641370 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:26.755953 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:26.871955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:27.330671 run create_hlr_db(pid=18596): Launched 03:16:27.445407 bus /sierra_2: Setting Powered False 03:16:28.504854 run create_hlr_db(pid=18596): Terminated: ok {rc=0} 03:16:28.938800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18598): Launched 03:16:29.256777 run osmo-hlr_10.42.42.2(pid=18599): Launched 03:16:29.378656 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:29.925399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18601): Launched 03:16:30.243679 run osmo-stp_10.42.42.5(pid=18602): Launched 03:16:30.372672 tst emergency_mo_mt_call.py: using MSISDN 7518 03:16:30.534844 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:31.133694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18604): Launched 03:16:31.457697 run osmo-msc_10.42.42.6(pid=18605): Launched 03:16:31.692722 run osmo-stp_10.42.42.5(pid=18602): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18602)] 03:16:31.997592 run osmo-stp_10.42.42.5(pid=18602): stdout: | (launched: 2022-12-10_03:16:30.185535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:32.198949 run osmo-stp_10.42.42.5(pid=18602): stderr: | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031630380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:32.356596 run osmo-stp_10.42.42.5(pid=18602): stdout: | (launched: 2022-12-10_03:16:30.185535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:32.483866 run osmo-stp_10.42.42.5(pid=18602): stderr: | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031630379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031630380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031630380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:32.635166 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18602): Process ended prematurely: osmo-stp_10.42.42.5(pid=18602) [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18602)] [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 03:16:32.644110 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 03:16:32.671706 run osmo-hlr_10.42.42.2(pid=18599): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18599)] 03:16:32.722520 run osmo-hlr_10.42.42.2(pid=18599): stdout: | (launched: 2022-12-10_03:16:29.199227) 03:16:32.775031 run osmo-hlr_10.42.42.2(pid=18599): stderr: | [0;m[1;31m20221210031629398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031629398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031629398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031629399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031629399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031629399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031629421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031629431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031629431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031629431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:32.848136 run osmo-msc_10.42.42.6(pid=18605): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18605)] 03:16:32.898898 run osmo-msc_10.42.42.6(pid=18605): stdout: | (launched: 2022-12-10_03:16:31.387606) 03:16:32.951249 run osmo-msc_10.42.42.6(pid=18605): stderr: | [0;m[38;5;43m20221210031631934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031631935 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8db533c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031631935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031631935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031631935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031631935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031631937 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031631937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031631937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031631938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:33.004109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18598): Terminating (SIGTERM) 03:16:33.046285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18601): Terminating (SIGTERM) 03:16:33.088634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18604): Terminating (SIGTERM) 03:16:33.131894 --- ParallelTerminationStrategy: PID 18598 died... 03:16:33.152158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18598): Terminated: ok {rc=0} 03:16:33.198952 --- ParallelTerminationStrategy: PID 18601 died... 03:16:33.218916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18601): Terminated: ok {rc=0} 03:16:33.265476 --- ParallelTerminationStrategy: PID 18604 died... 03:16:33.285377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18604): Terminated: ok {rc=0} 03:16:33.373949 bus /sierra_3: Setting Powered False 03:16:34.472434 bus /sierra_3: Setting Powered False 03:16:35.588850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 03:16:36.676096 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:36.687990 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:36.739080 tst emergency_preemptive_call.py: using LAC 25610 03:16:36.863629 tst emergency_preemptive_call.py: using RAC 110 03:16:36.988675 tst emergency_preemptive_call.py: using CellId 25610 03:16:37.117056 tst emergency_preemptive_call.py: using BVCI 25611 03:16:37.233015 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:37.244254 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:37.255251 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:37.266271 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:37.277191 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:37.288003 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:37.403311 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:37.522744 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:37.636195 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:37.752357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:38.246897 run create_hlr_db(pid=18607): Launched 03:16:38.377335 bus /sierra_2: Setting Powered False 03:16:39.440566 run create_hlr_db(pid=18607): Terminated: ok {rc=0} 03:16:39.867970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18609): Launched 03:16:40.166543 run osmo-hlr_10.42.42.2(pid=18610): Launched 03:16:40.280288 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:40.809536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18612): Launched 03:16:41.106648 run osmo-stp_10.42.42.5(pid=18613): Launched 03:16:41.227739 tst emergency_preemptive_call.py: using MSISDN 7519 03:16:41.394557 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:41.926108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18615): Launched 03:16:42.223111 run osmo-msc_10.42.42.6(pid=18616): Launched 03:16:42.389500 run osmo-stp_10.42.42.5(pid=18613): ERR: Terminated: ERROR {rc=1} [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18613)] 03:16:42.515190 run osmo-stp_10.42.42.5(pid=18613): stdout: | (launched: 2022-12-10_03:16:41.051753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:42.641824 run osmo-stp_10.42.42.5(pid=18613): stderr: | [0;m[38;5;43m20221210031641222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031641222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031641223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031641223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:42.765823 run osmo-stp_10.42.42.5(pid=18613): stdout: | (launched: 2022-12-10_03:16:41.051753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:42.883634 run osmo-stp_10.42.42.5(pid=18613): stderr: | [0;m[38;5;43m20221210031641222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031641222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031641223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031641223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031641224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:43.025061 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18613): Process ended prematurely: osmo-stp_10.42.42.5(pid=18613) [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18613)] [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 03:16:43.033438 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 03:16:43.060122 run osmo-hlr_10.42.42.2(pid=18610): ERR: Terminated: ERROR {rc=237} [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18610)] 03:16:43.107640 run osmo-hlr_10.42.42.2(pid=18610): stdout: | (launched: 2022-12-10_03:16:40.112053) 03:16:43.157252 run osmo-hlr_10.42.42.2(pid=18610): stderr: | [0;m[1;31m20221210031640284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031640284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031640284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031640284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031640284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031640285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031640295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031640304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031640304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031640304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:43.225854 run osmo-msc_10.42.42.6(pid=18616): ERR: Terminated: ERROR {rc=2} [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18616)] 03:16:43.273402 run osmo-msc_10.42.42.6(pid=18616): stdout: | (launched: 2022-12-10_03:16:42.168577) 03:16:43.322586 run osmo-msc_10.42.42.6(pid=18616): stderr: | [0;m[38;5;43m20221210031642439 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210031642439 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61192b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210031642439 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210031642439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210031642439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210031642440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210031642442 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210031642443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210031642443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210031642443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:43.372252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18609): Terminating (SIGTERM) 03:16:43.412057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18612): Terminating (SIGTERM) 03:16:43.452129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18615): Terminating (SIGTERM) 03:16:43.492346 --- ParallelTerminationStrategy: PID 18609 died... 03:16:43.511570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18609): Terminated: ok {rc=0} 03:16:43.556450 --- ParallelTerminationStrategy: PID 18612 died... 03:16:43.575273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18612): Terminated: ok {rc=0} 03:16:43.619745 --- ParallelTerminationStrategy: PID 18615 died... 03:16:43.638534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18615): Terminated: ok {rc=0} 03:16:43.724065 bus /sierra_9: Setting Powered False 03:16:44.824569 bus /sierra_9: Setting Powered False 03:16:45.950893 bus /sierra_8: Setting Powered False 03:16:47.052829 bus /sierra_8: Setting Powered False 03:16:48.168859 bus /sierra_3: Setting Powered False 03:16:49.267026 bus /sierra_3: Setting Powered False 03:16:50.382991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900 --------------------------------------------------------------------- 03:16:51.655081 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:51.660153 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:16:51.692505 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 03:16:51.730627 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:16:51.815873 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:16:51.847691 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 03:16:51.885755 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:16:52.478533 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 03:16:52.528654 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:52.539353 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:52.586211 tst cs_paging_gprs_active.py: using LAC 25611 03:16:52.707240 tst cs_paging_gprs_active.py: using RAC 111 03:16:52.827391 tst cs_paging_gprs_active.py: using CellId 25611 03:16:52.957155 tst cs_paging_gprs_active.py: using BVCI 25612 03:16:53.075382 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.087187 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.098534 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.109871 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.120884 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.132315 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.143620 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.154611 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:53.165852 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:53.283360 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:53.404475 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:16:53.623853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:16:53.950035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Launched 03:16:54.232530 run iperf3-srv_10.42.42.10(pid=18623): Launched 03:16:54.355185 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:16:54.573699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:16:54.898475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18624): Launched 03:16:55.181343 run iperf3-srv_10.42.42.10(pid=18625): Launched 03:16:55.304925 tst cs_paging_gprs_active.py:38: start network... 03:16:55.523801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:56.026900 run create_hlr_db(pid=18626): Launched 03:16:56.159973 bus /sierra_2: Setting Powered False 03:16:57.224588 run create_hlr_db(pid=18626): Terminated: ok {rc=0} 03:16:57.659067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18628): Launched 03:16:57.962605 run osmo-hlr_10.42.42.2(pid=18629): Launched 03:16:58.079415 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:58.617543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18631): Launched 03:16:58.921676 run osmo-stp_10.42.42.5(pid=18632): Launched 03:16:59.037936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:16:59.561848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18634): Launched 03:16:59.677991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:16:59.933363 run patchelf(pid=18635): Launched 03:17:00.102573 run osmo-stp_10.42.42.5(pid=18632): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18632)] 03:17:00.231423 run osmo-stp_10.42.42.5(pid=18632): stdout: | (launched: 2022-12-10_03:16:58.865957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:00.361642 run osmo-stp_10.42.42.5(pid=18632): stderr: | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031659035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:00.492182 run osmo-stp_10.42.42.5(pid=18632): stdout: | (launched: 2022-12-10_03:16:58.865957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:00.618112 run osmo-stp_10.42.42.5(pid=18632): stderr: | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031659034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031659035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031659037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:00.766217 run patchelf(pid=18635): Terminating (SIGINT) 03:17:00.952857 run patchelf(pid=18635): Terminated: ok {rc=0} 03:17:01.088371 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18632): Process ended prematurely: osmo-stp_10.42.42.5(pid=18632) [trial-2368↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18632)] [trial-2368↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 03:17:01.103523 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:17:01.143957 run osmo-hlr_10.42.42.2(pid=18629): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18629)] 03:17:01.199344 run osmo-hlr_10.42.42.2(pid=18629): stdout: | (launched: 2022-12-10_03:16:57.906833) 03:17:01.252852 run osmo-hlr_10.42.42.2(pid=18629): stderr: | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031658081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031658098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031658108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031658109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031658109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:01.308414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Terminating (SIGTERM) 03:17:01.352250 run iperf3-srv_10.42.42.10(pid=18623): Terminating (SIGTERM) 03:17:01.396436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18624): Terminating (SIGTERM) 03:17:01.441792 run iperf3-srv_10.42.42.10(pid=18625): Terminating (SIGTERM) 03:17:01.485962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18628): Terminating (SIGTERM) 03:17:01.530703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18631): Terminating (SIGTERM) 03:17:01.576822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18634): Terminating (SIGTERM) 03:17:01.622391 --- ParallelTerminationStrategy: PID 18622 died... 03:17:01.643122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18622): Terminated: ok {rc=0} 03:17:01.692416 --- ParallelTerminationStrategy: PID 18623 died... 03:17:01.713824 run iperf3-srv_10.42.42.10(pid=18623): Terminated {rc=256} 03:17:01.761116 --- ParallelTerminationStrategy: PID 18624 died... 03:17:01.781891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18624): Terminated: ok {rc=0} 03:17:01.829540 --- ParallelTerminationStrategy: PID 18625 died... 03:17:01.849985 run iperf3-srv_10.42.42.10(pid=18625): Terminated {rc=256} 03:17:01.897636 --- ParallelTerminationStrategy: PID 18628 died... 03:17:01.919338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18628): Terminated: ok {rc=0} 03:17:01.966497 --- ParallelTerminationStrategy: PID 18631 died... 03:17:01.987261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18631): Terminated: ok {rc=0} 03:17:02.034849 --- ParallelTerminationStrategy: PID 18634 died... 03:17:02.055900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18634): Terminated: ok {rc=0} 03:17:02.150539 bus /gobi_0: Setting Powered False 03:17:03.251423 bus /gobi_0: Setting Powered False 03:17:04.367344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 03:17:05.517320 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:05.529225 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:05.580570 tst iperf3.py: using LAC 25612 03:17:05.708307 tst iperf3.py: using RAC 112 03:17:05.835246 tst iperf3.py: using CellId 25612 03:17:05.962750 tst iperf3.py: using BVCI 25613 03:17:06.080285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.091855 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.103108 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.114046 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.124786 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.135637 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.146816 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.157690 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:06.168654 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:06.282956 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:06.486985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:06.792684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Launched 03:17:07.058473 run iperf3-srv_10.42.42.10(pid=18640): Launched 03:17:07.173505 tst iperf3.py:8: start network... 03:17:07.376349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:07.846028 run create_hlr_db(pid=18641): Launched 03:17:07.963653 bus /gobi_6: Setting Powered False 03:17:09.025167 run create_hlr_db(pid=18641): Terminated: ok {rc=0} 03:17:09.469348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Launched 03:17:09.795618 run osmo-hlr_10.42.42.2(pid=18644): Launched 03:17:09.920316 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:10.481416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Launched 03:17:10.808247 run osmo-stp_10.42.42.5(pid=18647): Launched 03:17:10.932627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:11.491291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18649): Launched 03:17:11.615517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:11.889662 run patchelf(pid=18650): Launched 03:17:12.070910 run osmo-stp_10.42.42.5(pid=18647): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] 03:17:12.208398 run osmo-stp_10.42.42.5(pid=18647): stdout: | (launched: 2022-12-10_03:17:10.748840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:12.347155 run osmo-stp_10.42.42.5(pid=18647): stderr: | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031710943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:12.486112 run osmo-stp_10.42.42.5(pid=18647): stdout: | (launched: 2022-12-10_03:17:10.748840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:12.619468 run osmo-stp_10.42.42.5(pid=18647): stderr: | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031710943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031710943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031710944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:12.777943 run patchelf(pid=18650): Terminating (SIGINT) 03:17:12.959832 run patchelf(pid=18650): Terminated: ok {rc=0} 03:17:13.090426 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18647): Process ended prematurely: osmo-stp_10.42.42.5(pid=18647) [trial-2368↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] [trial-2368↪gprs:nanobts+band-900↪iperf3.py:8] 03:17:13.100800 tst iperf3.py:8: Test FAILED (7.6 sec) 03:17:13.129348 run osmo-hlr_10.42.42.2(pid=18644): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18644)] 03:17:13.179087 run osmo-hlr_10.42.42.2(pid=18644): stdout: | (launched: 2022-12-10_03:17:09.736206) 03:17:13.230738 run osmo-hlr_10.42.42.2(pid=18644): stderr: | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031709936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031709949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031709957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031709957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031709957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:13.282522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Terminating (SIGTERM) 03:17:13.324370 run iperf3-srv_10.42.42.10(pid=18640): Terminating (SIGTERM) 03:17:13.366219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Terminating (SIGTERM) 03:17:13.408102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Terminating (SIGTERM) 03:17:13.449848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18649): Terminating (SIGTERM) 03:17:13.491917 --- ParallelTerminationStrategy: PID 18639 died... 03:17:13.511910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18639): Terminated: ok {rc=0} 03:17:13.558203 --- ParallelTerminationStrategy: PID 18640 died... 03:17:13.577755 run iperf3-srv_10.42.42.10(pid=18640): Terminated {rc=256} 03:17:13.623622 --- ParallelTerminationStrategy: PID 18643 died... 03:17:13.643157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Terminated: ok {rc=0} 03:17:13.689234 --- ParallelTerminationStrategy: PID 18646 died... 03:17:13.708620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Terminated: ok {rc=0} 03:17:13.754564 --- ParallelTerminationStrategy: PID 18649 died... 03:17:13.774234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18649): Terminated: ok {rc=0} 03:17:13.861074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 03:17:15.010900 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.022694 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:15.071718 tst iperf3m4.py: using LAC 25613 03:17:15.201165 tst iperf3m4.py: using RAC 113 03:17:15.331872 tst iperf3m4.py: using CellId 25613 03:17:15.459185 tst iperf3m4.py: using BVCI 25614 03:17:15.578223 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.589611 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.600692 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.611964 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.623215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.634550 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.645986 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.657088 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:15.668356 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:15.786848 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:15.928239 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:16.043495 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:16.181559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:16.408585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:16.749058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18651): Launched 03:17:17.050514 run iperf3-srv_10.42.42.10(pid=18652): Launched 03:17:17.176516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:17:17.395772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:17.721706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18653): Launched 03:17:18.004427 run iperf3-srv_10.42.42.10(pid=18654): Launched 03:17:18.127305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:17:18.345823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:18.670621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18655): Launched 03:17:18.953581 run iperf3-srv_10.42.42.10(pid=18656): Launched 03:17:19.076240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:17:19.296034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:19.622779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18657): Launched 03:17:19.904816 run iperf3-srv_10.42.42.10(pid=18658): Launched 03:17:20.027090 tst iperf3m4.py:8: start network... 03:17:20.246146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:20.750484 run create_hlr_db(pid=18659): Launched 03:17:20.883563 bus /gobi_6: Setting Powered False 03:17:21.947993 run create_hlr_db(pid=18659): Terminated: ok {rc=0} 03:17:22.382816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18661): Launched 03:17:22.688532 run osmo-hlr_10.42.42.2(pid=18662): Launched 03:17:22.805116 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:23.343279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18664): Launched 03:17:23.649330 run osmo-stp_10.42.42.5(pid=18665): Launched 03:17:23.766529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:24.291721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18667): Launched 03:17:24.408023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:24.664207 run patchelf(pid=18668): Launched 03:17:24.833666 run osmo-stp_10.42.42.5(pid=18665): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18665)] 03:17:24.961913 run osmo-stp_10.42.42.5(pid=18665): stdout: | (launched: 2022-12-10_03:17:23.592655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:25.091336 run osmo-stp_10.42.42.5(pid=18665): stderr: | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031723766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:25.221548 run osmo-stp_10.42.42.5(pid=18665): stdout: | (launched: 2022-12-10_03:17:23.592655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:25.346082 run osmo-stp_10.42.42.5(pid=18665): stderr: | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031723766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031723766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:25.493061 run patchelf(pid=18668): Terminating (SIGINT) 03:17:25.663757 run patchelf(pid=18668): Terminated: ok {rc=0} 03:17:25.786894 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18665): Process ended prematurely: osmo-stp_10.42.42.5(pid=18665) [trial-2368↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18665)] [trial-2368↪gprs:nanobts+band-900↪iperf3m4.py:8] 03:17:25.796209 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:17:25.824522 run osmo-hlr_10.42.42.2(pid=18662): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18662)] 03:17:25.873083 run osmo-hlr_10.42.42.2(pid=18662): stdout: | (launched: 2022-12-10_03:17:22.632121) 03:17:25.922973 run osmo-hlr_10.42.42.2(pid=18662): stderr: | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031722809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031722822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031722830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031722831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031722831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:25.973803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18651): Terminating (SIGTERM) 03:17:26.014062 run iperf3-srv_10.42.42.10(pid=18652): Terminating (SIGTERM) 03:17:26.054253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18653): Terminating (SIGTERM) 03:17:26.094634 run iperf3-srv_10.42.42.10(pid=18654): Terminating (SIGTERM) 03:17:26.134809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18655): Terminating (SIGTERM) 03:17:26.175027 run iperf3-srv_10.42.42.10(pid=18656): Terminating (SIGTERM) 03:17:26.215124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18657): Terminating (SIGTERM) 03:17:26.255304 run iperf3-srv_10.42.42.10(pid=18658): Terminating (SIGTERM) 03:17:26.295483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18661): Terminating (SIGTERM) 03:17:26.335713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18664): Terminating (SIGTERM) 03:17:26.375820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18667): Terminating (SIGTERM) 03:17:26.416326 --- ParallelTerminationStrategy: PID 18651 died... 03:17:26.435721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18651): Terminated: ok {rc=0} 03:17:26.480577 --- ParallelTerminationStrategy: PID 18652 died... 03:17:26.499439 run iperf3-srv_10.42.42.10(pid=18652): Terminated {rc=256} 03:17:26.543948 --- ParallelTerminationStrategy: PID 18653 died... 03:17:26.562743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18653): Terminated: ok {rc=0} 03:17:26.607310 --- ParallelTerminationStrategy: PID 18654 died... 03:17:26.626016 run iperf3-srv_10.42.42.10(pid=18654): Terminated {rc=256} 03:17:26.670442 --- ParallelTerminationStrategy: PID 18655 died... 03:17:26.689141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18655): Terminated: ok {rc=0} 03:17:26.733517 --- ParallelTerminationStrategy: PID 18656 died... 03:17:26.752156 run iperf3-srv_10.42.42.10(pid=18656): Terminated {rc=256} 03:17:26.797538 --- ParallelTerminationStrategy: PID 18657 died... 03:17:26.816101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18657): Terminated: ok {rc=0} 03:17:26.860820 --- ParallelTerminationStrategy: PID 18658 died... 03:17:26.879989 run iperf3-srv_10.42.42.10(pid=18658): Terminated {rc=256} 03:17:26.924321 --- ParallelTerminationStrategy: PID 18661 died... 03:17:26.943059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18661): Terminated: ok {rc=0} 03:17:26.987908 --- ParallelTerminationStrategy: PID 18664 died... 03:17:27.006709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18664): Terminated: ok {rc=0} 03:17:27.051017 --- ParallelTerminationStrategy: PID 18667 died... 03:17:27.069912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18667): Terminated: ok {rc=0} 03:17:27.156690 bus /gobi_4: Setting Powered False 03:17:28.257143 bus /gobi_4: Setting Powered False 03:17:29.374154 bus /gobi_1: Setting Powered False 03:17:30.473520 bus /gobi_1: Setting Powered False 03:17:31.601698 bus /gobi_0: Setting Powered False 03:17:32.714940 bus /gobi_0: Setting Powered False 03:17:33.832357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900 ping.py ---------------------------------------------- 03:17:34.936138 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:34.947933 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:34.997356 tst ping.py: using LAC 25614 03:17:35.124711 tst ping.py: using RAC 114 03:17:35.254291 tst ping.py: using CellId 25614 03:17:35.379183 tst ping.py: using BVCI 25615 03:17:35.494579 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.505743 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.516906 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.528194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.539174 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.550172 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.561457 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:35.572419 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:35.692842 tst ping.py:19: start network... 03:17:35.907105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:36.400500 run create_hlr_db(pid=18675): Launched 03:17:36.529566 bus /gobi_6: Setting Powered False 03:17:37.593131 run create_hlr_db(pid=18675): Terminated: ok {rc=0} 03:17:38.019718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Launched 03:17:38.318300 run osmo-hlr_10.42.42.2(pid=18678): Launched 03:17:38.431922 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:38.966309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Launched 03:17:39.263727 run osmo-stp_10.42.42.5(pid=18681): Launched 03:17:39.377596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:39.890436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18683): Launched 03:17:40.005454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:40.259870 run patchelf(pid=18684): Launched 03:17:40.427437 run osmo-stp_10.42.42.5(pid=18681): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] 03:17:40.554157 run osmo-stp_10.42.42.5(pid=18681): stdout: | (launched: 2022-12-10_03:17:39.209313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:40.682508 run osmo-stp_10.42.42.5(pid=18681): stderr: | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031739379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:40.811348 run osmo-stp_10.42.42.5(pid=18681): stdout: | (launched: 2022-12-10_03:17:39.209313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:40.934205 run osmo-stp_10.42.42.5(pid=18681): stderr: | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031739379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031739379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031739380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:41.079144 run patchelf(pid=18684): Terminating (SIGINT) 03:17:41.247301 run patchelf(pid=18684): Terminated: ok {rc=0} 03:17:41.368128 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18681): Process ended prematurely: osmo-stp_10.42.42.5(pid=18681) [trial-2368↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] [trial-2368↪gprs:nanobts+band-900↪ping.py:22] 03:17:41.376942 tst ping.py:22: Test FAILED (6.4 sec) 03:17:41.404112 run osmo-hlr_10.42.42.2(pid=18678): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18678)] 03:17:41.452358 run osmo-hlr_10.42.42.2(pid=18678): stdout: | (launched: 2022-12-10_03:17:38.263500) 03:17:41.502427 run osmo-hlr_10.42.42.2(pid=18678): stderr: | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031738436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031738449 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031738458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031738459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031738459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:41.553047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Terminating (SIGTERM) 03:17:41.593260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Terminating (SIGTERM) 03:17:41.633582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18683): Terminating (SIGTERM) 03:17:41.674169 --- ParallelTerminationStrategy: PID 18677 died... 03:17:41.693447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Terminated: ok {rc=0} 03:17:41.738079 --- ParallelTerminationStrategy: PID 18680 died... 03:17:41.756647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Terminated: ok {rc=0} 03:17:41.801197 --- ParallelTerminationStrategy: PID 18683 died... 03:17:41.819932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18683): Terminated: ok {rc=0} 03:17:41.904347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 03:17:42.991553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.003802 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:43.054711 tst ping_idle_ping.py: using LAC 25615 03:17:43.183042 tst ping_idle_ping.py: using RAC 115 03:17:43.312862 tst ping_idle_ping.py: using CellId 25615 03:17:43.440533 tst ping_idle_ping.py: using BVCI 25616 03:17:43.558371 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.569555 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.580513 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.591689 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.602831 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.613949 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.625215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:43.636371 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:43.750857 tst ping_idle_ping.py:24: start network... 03:17:43.952264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:44.417719 run create_hlr_db(pid=18685): Launched 03:17:44.550030 bus /gobi_6: Setting Powered False 03:17:45.613272 run create_hlr_db(pid=18685): Terminated: ok {rc=0} 03:17:46.105204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Launched 03:17:46.452000 run osmo-hlr_10.42.42.2(pid=18688): Launched 03:17:46.662492 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:47.360778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18692): Launched 03:17:47.686061 run osmo-stp_10.42.42.5(pid=18694): Launched 03:17:47.801997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:48.351295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18696): Launched 03:17:48.476864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:48.749110 run patchelf(pid=18697): Launched 03:17:48.928463 run osmo-stp_10.42.42.5(pid=18694): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18694)] 03:17:49.061751 run osmo-stp_10.42.42.5(pid=18694): stdout: | (launched: 2022-12-10_03:17:47.626145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:49.191052 run osmo-stp_10.42.42.5(pid=18694): stderr: | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031747801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:49.320108 run osmo-stp_10.42.42.5(pid=18694): stdout: | (launched: 2022-12-10_03:17:47.626145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:49.442338 run osmo-stp_10.42.42.5(pid=18694): stderr: | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031747800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031747801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:49.589248 run patchelf(pid=18697): Terminating (SIGINT) 03:17:49.758010 run patchelf(pid=18697): Terminated: ok {rc=0} 03:17:49.880283 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18694): Process ended prematurely: osmo-stp_10.42.42.5(pid=18694) [trial-2368↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18694)] [trial-2368↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 03:17:49.889141 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 03:17:49.916733 run osmo-hlr_10.42.42.2(pid=18688): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18688)] 03:17:49.965162 run osmo-hlr_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-10_03:17:46.382727) 03:17:50.015474 run osmo-hlr_10.42.42.2(pid=18688): stderr: | [0;m[1;31m20221210031746742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031746742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031746742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031746742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031746743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031746743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031746766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031746783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031746783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031746783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:50.066048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminating (SIGTERM) 03:17:50.107314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18692): Terminating (SIGTERM) 03:17:50.148074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18696): Terminating (SIGTERM) 03:17:50.188442 --- ParallelTerminationStrategy: PID 18687 died... 03:17:50.207617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminated: ok {rc=0} 03:17:50.251887 --- ParallelTerminationStrategy: PID 18692 died... 03:17:50.270662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18692): Terminated: ok {rc=0} 03:17:50.315045 --- ParallelTerminationStrategy: PID 18696 died... 03:17:50.333883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18696): Terminated: ok {rc=0} 03:17:50.417908 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 03:17:51.720930 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:17:51.727854 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:17:51.760712 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:17:51.799869 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:17:51.889869 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:17:51.923162 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:17:51.964161 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:17:52.563507 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:17:52.614620 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:52.625827 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:17:52.674646 tst cs_paging_gprs_active.py: using LAC 25616 03:17:52.803961 tst cs_paging_gprs_active.py: using RAC 116 03:17:52.931695 tst cs_paging_gprs_active.py: using CellId 25616 03:17:53.062681 tst cs_paging_gprs_active.py: using BVCI 25617 03:17:53.183029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.194492 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.205641 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.216620 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.227578 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.238752 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.250026 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.261141 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:53.274593 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:17:53.393785 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:17:53.515468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:17:53.722794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:54.030080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18706): Launched 03:17:54.295910 run iperf3-srv_10.42.42.10(pid=18707): Launched 03:17:54.413101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:17:54.616723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:54.922452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18708): Launched 03:17:55.188109 run iperf3-srv_10.42.42.10(pid=18709): Launched 03:17:55.302930 tst cs_paging_gprs_active.py:38: start network... 03:17:55.506639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:55.979001 run create_hlr_db(pid=18711): Launched 03:17:56.097479 bus /gobi_6: Setting Powered False 03:17:57.157565 run create_hlr_db(pid=18711): Terminated: ok {rc=0} 03:17:57.582459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18713): Launched 03:17:57.888804 run osmo-hlr_10.42.42.2(pid=18714): Launched 03:17:58.007325 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:58.576930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18716): Launched 03:17:58.903188 run osmo-stp_10.42.42.5(pid=18717): Launched 03:17:59.027709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:59.596098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18719): Launched 03:17:59.720548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:59.994616 run patchelf(pid=18720): Launched 03:18:00.175925 run osmo-stp_10.42.42.5(pid=18717): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18717)] 03:18:00.313284 run osmo-stp_10.42.42.5(pid=18717): stdout: | (launched: 2022-12-10_03:17:58.843784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:00.451765 run osmo-stp_10.42.42.5(pid=18717): stderr: | [0;m[38;5;43m20221210031759034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031759034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031759035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031759035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031759037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031759038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031759038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:00.590393 run osmo-stp_10.42.42.5(pid=18717): stdout: | (launched: 2022-12-10_03:17:58.843784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:00.723690 run osmo-stp_10.42.42.5(pid=18717): stderr: | [0;m[38;5;43m20221210031759034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031759034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031759035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031759035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031759037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031759038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031759038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:00.882493 run patchelf(pid=18720): Terminating (SIGINT) 03:18:01.067712 run patchelf(pid=18720): Terminated: ok {rc=0} 03:18:01.203177 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18717): Process ended prematurely: osmo-stp_10.42.42.5(pid=18717) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18717)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:18:01.213799 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:18:01.242929 run osmo-hlr_10.42.42.2(pid=18714): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18714)] 03:18:01.293941 run osmo-hlr_10.42.42.2(pid=18714): stdout: | (launched: 2022-12-10_03:17:57.832376) 03:18:01.346869 run osmo-hlr_10.42.42.2(pid=18714): stderr: | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031758015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031758027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031758036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031758037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031758037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:01.400065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18706): Terminating (SIGTERM) 03:18:01.443135 run iperf3-srv_10.42.42.10(pid=18707): Terminating (SIGTERM) 03:18:01.490627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18708): Terminating (SIGTERM) 03:18:01.534102 run iperf3-srv_10.42.42.10(pid=18709): Terminating (SIGTERM) 03:18:01.579665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18713): Terminating (SIGTERM) 03:18:01.623123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18716): Terminating (SIGTERM) 03:18:01.666971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18719): Terminating (SIGTERM) 03:18:01.710035 --- ParallelTerminationStrategy: PID 18706 died... 03:18:01.730106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18706): Terminated: ok {rc=0} 03:18:01.776560 --- ParallelTerminationStrategy: PID 18707 died... 03:18:01.796712 run iperf3-srv_10.42.42.10(pid=18707): Terminated {rc=256} 03:18:01.844152 --- ParallelTerminationStrategy: PID 18708 died... 03:18:01.864508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18708): Terminated: ok {rc=0} 03:18:01.911709 --- ParallelTerminationStrategy: PID 18709 died... 03:18:01.931699 run iperf3-srv_10.42.42.10(pid=18709): Terminated {rc=256} 03:18:01.978593 --- ParallelTerminationStrategy: PID 18713 died... 03:18:01.998672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18713): Terminated: ok {rc=0} 03:18:02.047604 --- ParallelTerminationStrategy: PID 18716 died... 03:18:02.067771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18716): Terminated: ok {rc=0} 03:18:02.114443 --- ParallelTerminationStrategy: PID 18719 died... 03:18:02.134916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18719): Terminated: ok {rc=0} 03:18:02.227914 bus /gobi_0: Setting Powered False 03:18:03.331714 bus /gobi_0: Setting Powered False 03:18:04.445971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:18:05.592022 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:05.603344 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:05.654358 tst iperf3.py: using LAC 25617 03:18:05.774460 tst iperf3.py: using RAC 117 03:18:05.898733 tst iperf3.py: using CellId 25617 03:18:06.018902 tst iperf3.py: using BVCI 25618 03:18:06.131451 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.142463 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.153177 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.164207 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.175098 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.186029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.197087 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.207730 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:06.218779 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:06.331782 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:06.535688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:06.841936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18721): Launched 03:18:07.108697 run iperf3-srv_10.42.42.10(pid=18722): Launched 03:18:07.224357 tst iperf3.py:8: start network... 03:18:07.429175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:07.904586 run create_hlr_db(pid=18724): Launched 03:18:08.024332 bus /gobi_6: Setting Powered False 03:18:09.085339 run create_hlr_db(pid=18724): Terminated: ok {rc=0} 03:18:09.532031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18726): Launched 03:18:09.856836 run osmo-hlr_10.42.42.2(pid=18727): Launched 03:18:09.983463 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:10.546652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18729): Launched 03:18:10.871607 run osmo-stp_10.42.42.5(pid=18730): Launched 03:18:10.995351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:11.542340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18732): Launched 03:18:11.670771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:11.947045 run patchelf(pid=18733): Launched 03:18:12.128627 run osmo-stp_10.42.42.5(pid=18730): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18730)] 03:18:12.265535 run osmo-stp_10.42.42.5(pid=18730): stdout: | (launched: 2022-12-10_03:18:10.811987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:12.403567 run osmo-stp_10.42.42.5(pid=18730): stderr: | [0;m[38;5;43m20221210031811009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031811010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031811010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031811010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:12.541999 run osmo-stp_10.42.42.5(pid=18730): stdout: | (launched: 2022-12-10_03:18:10.811987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:12.674852 run osmo-stp_10.42.42.5(pid=18730): stderr: | [0;m[38;5;43m20221210031811009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031811010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031811010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031811010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031811011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:12.831889 run patchelf(pid=18733): Terminating (SIGINT) 03:18:13.012759 run patchelf(pid=18733): Terminated: ok {rc=0} 03:18:13.143482 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18730): Process ended prematurely: osmo-stp_10.42.42.5(pid=18730) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18730)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 03:18:13.153565 tst iperf3.py:8: Test FAILED (7.6 sec) 03:18:13.182578 run osmo-hlr_10.42.42.2(pid=18727): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18727)] 03:18:13.233087 run osmo-hlr_10.42.42.2(pid=18727): stdout: | (launched: 2022-12-10_03:18:09.797619) 03:18:13.284926 run osmo-hlr_10.42.42.2(pid=18727): stderr: | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031809999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031810013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031810023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031810023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031810023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:13.337064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18721): Terminating (SIGTERM) 03:18:13.378589 run iperf3-srv_10.42.42.10(pid=18722): Terminating (SIGTERM) 03:18:13.420090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18726): Terminating (SIGTERM) 03:18:13.461857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18729): Terminating (SIGTERM) 03:18:13.503365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18732): Terminating (SIGTERM) 03:18:13.545501 --- ParallelTerminationStrategy: PID 18721 died... 03:18:13.565531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18721): Terminated: ok {rc=0} 03:18:13.611407 --- ParallelTerminationStrategy: PID 18722 died... 03:18:13.631077 run iperf3-srv_10.42.42.10(pid=18722): Terminated {rc=256} 03:18:13.676875 --- ParallelTerminationStrategy: PID 18726 died... 03:18:13.696883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18726): Terminated: ok {rc=0} 03:18:13.742765 --- ParallelTerminationStrategy: PID 18729 died... 03:18:13.762295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18729): Terminated: ok {rc=0} 03:18:13.807973 --- ParallelTerminationStrategy: PID 18732 died... 03:18:13.827493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18732): Terminated: ok {rc=0} 03:18:13.915207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:18:15.062961 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.074486 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:15.124117 tst iperf3m4.py: using LAC 25618 03:18:15.245391 tst iperf3m4.py: using RAC 118 03:18:15.364224 tst iperf3m4.py: using CellId 25618 03:18:15.484026 tst iperf3m4.py: using BVCI 25619 03:18:15.596694 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.607720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.618506 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.629554 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.640416 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.651293 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.662447 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.673868 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:15.684894 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:15.801428 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:15.958487 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:16.104868 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:16.251927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:16.524260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:16.865164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18734): Launched 03:18:17.170028 run iperf3-srv_10.42.42.10(pid=18735): Launched 03:18:17.311609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:18:17.530622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:17.856369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18736): Launched 03:18:18.139362 run iperf3-srv_10.42.42.10(pid=18737): Launched 03:18:18.261850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:18:18.480059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:18.805631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18738): Launched 03:18:19.091693 run iperf3-srv_10.42.42.10(pid=18739): Launched 03:18:19.207940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:18:19.419687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:19.748432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18740): Launched 03:18:20.032315 run iperf3-srv_10.42.42.10(pid=18741): Launched 03:18:20.155293 tst iperf3m4.py:8: start network... 03:18:20.374383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:20.879698 run create_hlr_db(pid=18742): Launched 03:18:21.012432 bus /gobi_6: Setting Powered False 03:18:22.073448 run create_hlr_db(pid=18742): Terminated: ok {rc=0} 03:18:22.514494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18744): Launched 03:18:22.840305 run osmo-hlr_10.42.42.2(pid=18745): Launched 03:18:22.967208 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:23.529310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18747): Launched 03:18:23.839292 run osmo-stp_10.42.42.5(pid=18748): Launched 03:18:23.955442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:24.484475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18750): Launched 03:18:24.601175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:24.861340 run patchelf(pid=18751): Launched 03:18:25.034252 run osmo-stp_10.42.42.5(pid=18748): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18748)] 03:18:25.169341 run osmo-stp_10.42.42.5(pid=18748): stdout: | (launched: 2022-12-10_03:18:23.782939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:25.308759 run osmo-stp_10.42.42.5(pid=18748): stderr: | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031823957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:25.447980 run osmo-stp_10.42.42.5(pid=18748): stdout: | (launched: 2022-12-10_03:18:23.782939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:25.581264 run osmo-stp_10.42.42.5(pid=18748): stderr: | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031823956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031823957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031823957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:25.738646 run patchelf(pid=18751): Terminating (SIGINT) 03:18:25.919870 run patchelf(pid=18751): Terminated: ok {rc=0} 03:18:26.050602 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18748): Process ended prematurely: osmo-stp_10.42.42.5(pid=18748) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18748)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 03:18:26.060602 tst iperf3m4.py:8: Test FAILED (11.0 sec) 03:18:26.089591 run osmo-hlr_10.42.42.2(pid=18745): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18745)] 03:18:26.139922 run osmo-hlr_10.42.42.2(pid=18745): stdout: | (launched: 2022-12-10_03:18:22.780568) 03:18:26.191843 run osmo-hlr_10.42.42.2(pid=18745): stderr: | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031822986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031822997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031823005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031823005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031823005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:26.244155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18734): Terminating (SIGTERM) 03:18:26.285920 run iperf3-srv_10.42.42.10(pid=18735): Terminating (SIGTERM) 03:18:26.327742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18736): Terminating (SIGTERM) 03:18:26.369475 run iperf3-srv_10.42.42.10(pid=18737): Terminating (SIGTERM) 03:18:26.411023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18738): Terminating (SIGTERM) 03:18:26.452720 run iperf3-srv_10.42.42.10(pid=18739): Terminating (SIGTERM) 03:18:26.494270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18740): Terminating (SIGTERM) 03:18:26.535855 run iperf3-srv_10.42.42.10(pid=18741): Terminating (SIGTERM) 03:18:26.577437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18744): Terminating (SIGTERM) 03:18:26.619098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18747): Terminating (SIGTERM) 03:18:26.660713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18750): Terminating (SIGTERM) 03:18:26.703251 --- ParallelTerminationStrategy: PID 18734 died... 03:18:26.723390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18734): Terminated: ok {rc=0} 03:18:26.769392 --- ParallelTerminationStrategy: PID 18735 died... 03:18:26.788737 run iperf3-srv_10.42.42.10(pid=18735): Terminated {rc=256} 03:18:26.834549 --- ParallelTerminationStrategy: PID 18736 died... 03:18:26.854044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18736): Terminated: ok {rc=0} 03:18:26.899786 --- ParallelTerminationStrategy: PID 18737 died... 03:18:26.919284 run iperf3-srv_10.42.42.10(pid=18737): Terminated {rc=256} 03:18:26.965082 --- ParallelTerminationStrategy: PID 18738 died... 03:18:26.984544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18738): Terminated: ok {rc=0} 03:18:27.030143 --- ParallelTerminationStrategy: PID 18739 died... 03:18:27.049600 run iperf3-srv_10.42.42.10(pid=18739): Terminated {rc=256} 03:18:27.095271 --- ParallelTerminationStrategy: PID 18740 died... 03:18:27.114819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18740): Terminated: ok {rc=0} 03:18:27.161172 --- ParallelTerminationStrategy: PID 18741 died... 03:18:27.181071 run iperf3-srv_10.42.42.10(pid=18741): Terminated {rc=256} 03:18:27.226710 --- ParallelTerminationStrategy: PID 18744 died... 03:18:27.246195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18744): Terminated: ok {rc=0} 03:18:27.292141 --- ParallelTerminationStrategy: PID 18747 died... 03:18:27.311816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18747): Terminated: ok {rc=0} 03:18:27.357706 --- ParallelTerminationStrategy: PID 18750 died... 03:18:27.377911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18750): Terminated: ok {rc=0} 03:18:27.469097 bus /gobi_4: Setting Powered False 03:18:28.569174 bus /gobi_4: Setting Powered False 03:18:29.688628 bus /gobi_1: Setting Powered False 03:18:30.788551 bus /gobi_1: Setting Powered False 03:18:31.909381 bus /gobi_0: Setting Powered False 03:18:33.011205 bus /gobi_0: Setting Powered False 03:18:34.129207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 03:18:35.233012 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.245286 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:35.296471 tst ping.py: using LAC 25619 03:18:35.425464 tst ping.py: using RAC 119 03:18:35.552677 tst ping.py: using CellId 25619 03:18:35.679211 tst ping.py: using BVCI 25620 03:18:35.795437 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.806970 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.818293 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.829598 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.840712 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.851927 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.863436 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:35.874727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:35.992074 tst ping.py:19: start network... 03:18:36.192013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:36.681729 run create_hlr_db(pid=18752): Launched 03:18:36.811423 bus /gobi_6: Setting Powered False 03:18:37.874144 run create_hlr_db(pid=18752): Terminated: ok {rc=0} 03:18:38.334182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Launched 03:18:38.634067 run osmo-hlr_10.42.42.2(pid=18761): Launched 03:18:38.747601 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:39.282192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Launched 03:18:39.580595 run osmo-stp_10.42.42.5(pid=18764): Launched 03:18:39.696186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:40.217968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Launched 03:18:40.332771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:40.587604 run patchelf(pid=18767): Launched 03:18:40.759212 run osmo-stp_10.42.42.5(pid=18764): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] 03:18:40.886518 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-10_03:18:39.525683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:41.020130 run osmo-stp_10.42.42.5(pid=18764): stderr: | [0;m[38;5;43m20221210031839699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031839699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031839700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031839700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:41.157908 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-10_03:18:39.525683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:41.292361 run osmo-stp_10.42.42.5(pid=18764): stderr: | [0;m[38;5;43m20221210031839699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031839699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031839700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031839700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031839701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:41.448663 run patchelf(pid=18767): Terminating (SIGINT) 03:18:41.631408 run patchelf(pid=18767): Terminated: ok {rc=0} 03:18:41.761224 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 03:18:41.770709 tst ping.py:22: Test FAILED (6.5 sec) 03:18:41.801989 run osmo-hlr_10.42.42.2(pid=18761): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18761)] 03:18:41.851285 run osmo-hlr_10.42.42.2(pid=18761): stdout: | (launched: 2022-12-10_03:18:38.578735) 03:18:41.901550 run osmo-hlr_10.42.42.2(pid=18761): stderr: | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031838755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031838768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031838778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031838779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031838779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:41.952311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminating (SIGTERM) 03:18:41.992772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminating (SIGTERM) 03:18:42.033203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Terminating (SIGTERM) 03:18:42.075474 --- ParallelTerminationStrategy: PID 18760 died... 03:18:42.094832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminated: ok {rc=0} 03:18:42.139567 --- ParallelTerminationStrategy: PID 18763 died... 03:18:42.158440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminated: ok {rc=0} 03:18:42.203064 --- ParallelTerminationStrategy: PID 18766 died... 03:18:42.221844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18766): Terminated: ok {rc=0} 03:18:42.310828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:18:43.399773 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.411371 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:43.462295 tst ping_idle_ping.py: using LAC 25620 03:18:43.581370 tst ping_idle_ping.py: using RAC 120 03:18:43.698559 tst ping_idle_ping.py: using CellId 25620 03:18:43.819935 tst ping_idle_ping.py: using BVCI 25621 03:18:43.937579 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.949311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.960666 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.972276 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.983556 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:43.994893 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:44.009536 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:44.021460 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:44.137955 tst ping_idle_ping.py:24: start network... 03:18:44.348418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:44.818304 run create_hlr_db(pid=18768): Launched 03:18:44.944741 bus /gobi_6: Setting Powered False 03:18:46.004667 run create_hlr_db(pid=18768): Terminated: ok {rc=0} 03:18:46.446473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Launched 03:18:46.770582 run osmo-hlr_10.42.42.2(pid=18771): Launched 03:18:47.006697 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:47.618793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Launched 03:18:47.940863 run osmo-stp_10.42.42.5(pid=18774): Launched 03:18:48.062549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:48.605926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18776): Launched 03:18:48.722576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:48.975766 run patchelf(pid=18777): Launched 03:18:49.143122 run osmo-stp_10.42.42.5(pid=18774): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] 03:18:49.279162 run osmo-stp_10.42.42.5(pid=18774): stdout: | (launched: 2022-12-10_03:18:47.882499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:49.416777 run osmo-stp_10.42.42.5(pid=18774): stderr: | [0;m[38;5;43m20221210031848077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031848077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031848078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031848078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:49.550199 run osmo-stp_10.42.42.5(pid=18774): stdout: | (launched: 2022-12-10_03:18:47.882499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:49.672452 run osmo-stp_10.42.42.5(pid=18774): stderr: | [0;m[38;5;43m20221210031848077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031848077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031848078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031848078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031848079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:49.819672 run patchelf(pid=18777): Terminating (SIGINT) 03:18:49.988056 run patchelf(pid=18777): Terminated: ok {rc=0} 03:18:50.119269 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18774): Process ended prematurely: osmo-stp_10.42.42.5(pid=18774) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:18:50.128585 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:18:50.157064 run osmo-hlr_10.42.42.2(pid=18771): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18771)] 03:18:50.207205 run osmo-hlr_10.42.42.2(pid=18771): stdout: | (launched: 2022-12-10_03:18:46.706940) 03:18:50.258971 run osmo-hlr_10.42.42.2(pid=18771): stderr: | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031847049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031847071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031847087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031847088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031847088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:50.313620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Terminating (SIGTERM) 03:18:50.353512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Terminating (SIGTERM) 03:18:50.393093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18776): Terminating (SIGTERM) 03:18:50.433208 --- ParallelTerminationStrategy: PID 18770 died... 03:18:50.452285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Terminated: ok {rc=0} 03:18:50.496607 --- ParallelTerminationStrategy: PID 18773 died... 03:18:50.515351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Terminated: ok {rc=0} 03:18:50.560420 --- ParallelTerminationStrategy: PID 18776 died... 03:18:50.583278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18776): Terminated: ok {rc=0} 03:18:50.671187 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:18:51.982131 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:18:51.990708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:18:52.023447 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:18:52.062910 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:18:52.151049 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:18:52.183878 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:18:52.223317 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:18:52.823938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:18:52.876156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:52.887680 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:18:52.955289 tst cs_paging_gprs_active.py: using LAC 25621 03:18:53.089914 tst cs_paging_gprs_active.py: using RAC 121 03:18:53.218281 tst cs_paging_gprs_active.py: using CellId 25621 03:18:53.343726 tst cs_paging_gprs_active.py: using BVCI 25622 03:18:53.463832 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.475360 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.486865 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.498328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.509809 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.521184 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.532683 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.543890 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:53.555350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:18:53.673615 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:18:53.791272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:18:53.995654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:54.301179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Launched 03:18:54.566875 run iperf3-srv_10.42.42.10(pid=18782): Launched 03:18:54.681901 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:18:54.885881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:55.192170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Launched 03:18:55.457932 run iperf3-srv_10.42.42.10(pid=18784): Launched 03:18:55.574434 tst cs_paging_gprs_active.py:38: start network... 03:18:55.777441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:56.248075 run create_hlr_db(pid=18785): Launched 03:18:56.366040 bus /gobi_6: Setting Powered False 03:18:57.427352 run create_hlr_db(pid=18785): Terminated: ok {rc=0} 03:18:57.861677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Launched 03:18:58.168552 run osmo-hlr_10.42.42.2(pid=18788): Launched 03:18:58.290840 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:58.852163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Launched 03:18:59.158374 run osmo-stp_10.42.42.5(pid=18791): Launched 03:18:59.276260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:59.804107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Launched 03:18:59.922066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:00.180286 run patchelf(pid=18794): Launched 03:19:00.350181 run osmo-stp_10.42.42.5(pid=18791): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] 03:19:00.480091 run osmo-stp_10.42.42.5(pid=18791): stdout: | (launched: 2022-12-10_03:18:59.102351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:00.610513 run osmo-stp_10.42.42.5(pid=18791): stderr: | [0;m[38;5;43m20221210031859272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031859273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031859273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031859273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:00.742756 run osmo-stp_10.42.42.5(pid=18791): stdout: | (launched: 2022-12-10_03:18:59.102351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:00.868869 run osmo-stp_10.42.42.5(pid=18791): stderr: | [0;m[38;5;43m20221210031859272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031859273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031859273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031859273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031859274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:01.025465 run patchelf(pid=18794): Terminating (SIGINT) 03:19:01.199529 run patchelf(pid=18794): Terminated: ok {rc=0} 03:19:01.326381 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18791): Process ended prematurely: osmo-stp_10.42.42.5(pid=18791) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:19:01.336571 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 03:19:01.365289 run osmo-hlr_10.42.42.2(pid=18788): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18788)] 03:19:01.414711 run osmo-hlr_10.42.42.2(pid=18788): stdout: | (launched: 2022-12-10_03:18:58.112398) 03:19:01.465976 run osmo-hlr_10.42.42.2(pid=18788): stderr: | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031858290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031858302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031858310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031858310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031858310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:01.517984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminating (SIGTERM) 03:19:01.559394 run iperf3-srv_10.42.42.10(pid=18782): Terminating (SIGTERM) 03:19:01.602005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminating (SIGTERM) 03:19:01.644066 run iperf3-srv_10.42.42.10(pid=18784): Terminating (SIGTERM) 03:19:01.686620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Terminating (SIGTERM) 03:19:01.727742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Terminating (SIGTERM) 03:19:01.769119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Terminating (SIGTERM) 03:19:01.812157 --- ParallelTerminationStrategy: PID 18781 died... 03:19:01.831958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminated: ok {rc=0} 03:19:01.877626 --- ParallelTerminationStrategy: PID 18782 died... 03:19:01.897291 run iperf3-srv_10.42.42.10(pid=18782): Terminated {rc=256} 03:19:01.942421 --- ParallelTerminationStrategy: PID 18783 died... 03:19:01.961640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminated: ok {rc=0} 03:19:02.006752 --- ParallelTerminationStrategy: PID 18784 died... 03:19:02.026094 run iperf3-srv_10.42.42.10(pid=18784): Terminated {rc=256} 03:19:02.071761 --- ParallelTerminationStrategy: PID 18787 died... 03:19:02.091418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18787): Terminated: ok {rc=0} 03:19:02.137723 --- ParallelTerminationStrategy: PID 18790 died... 03:19:02.157306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18790): Terminated: ok {rc=0} 03:19:02.202999 --- ParallelTerminationStrategy: PID 18793 died... 03:19:02.222307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18793): Terminated: ok {rc=0} 03:19:02.307918 bus /gobi_0: Setting Powered False 03:19:03.405974 bus /gobi_0: Setting Powered False 03:19:04.523319 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:19:05.668814 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:05.680505 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:05.749337 tst iperf3.py: using LAC 25622 03:19:05.869977 tst iperf3.py: using RAC 122 03:19:05.989362 tst iperf3.py: using CellId 25622 03:19:06.107013 tst iperf3.py: using BVCI 25623 03:19:06.219483 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.230443 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.241233 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.252083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.263075 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.274076 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.285230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.295892 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:06.306908 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:06.421775 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:06.626265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:06.932940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18795): Launched 03:19:07.200661 run iperf3-srv_10.42.42.10(pid=18796): Launched 03:19:07.317418 tst iperf3.py:8: start network... 03:19:07.520920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:07.995021 run create_hlr_db(pid=18797): Launched 03:19:08.112912 bus /gobi_6: Setting Powered False 03:19:09.178323 run create_hlr_db(pid=18797): Terminated: ok {rc=0} 03:19:09.623537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18799): Launched 03:19:09.929884 run osmo-hlr_10.42.42.2(pid=18800): Launched 03:19:10.050537 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:10.608632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18802): Launched 03:19:10.914023 run osmo-stp_10.42.42.5(pid=18803): Launched 03:19:11.029873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:11.555547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18805): Launched 03:19:11.673617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:11.938238 run patchelf(pid=18806): Launched 03:19:12.113877 run osmo-stp_10.42.42.5(pid=18803): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18803)] 03:19:12.243501 run osmo-stp_10.42.42.5(pid=18803): stdout: | (launched: 2022-12-10_03:19:10.858005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:12.373314 run osmo-stp_10.42.42.5(pid=18803): stderr: | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031911028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:12.503454 run osmo-stp_10.42.42.5(pid=18803): stdout: | (launched: 2022-12-10_03:19:10.858005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:12.628273 run osmo-stp_10.42.42.5(pid=18803): stderr: | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031911027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031911028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031911030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:12.776742 run patchelf(pid=18806): Terminating (SIGINT) 03:19:12.947992 run patchelf(pid=18806): Terminated: ok {rc=0} 03:19:13.072154 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18803): Process ended prematurely: osmo-stp_10.42.42.5(pid=18803) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18803)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:19:13.081634 tst iperf3.py:8: Test FAILED (7.4 sec) 03:19:13.109441 run osmo-hlr_10.42.42.2(pid=18800): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18800)] 03:19:13.157602 run osmo-hlr_10.42.42.2(pid=18800): stdout: | (launched: 2022-12-10_03:19:09.873985) 03:19:13.207300 run osmo-hlr_10.42.42.2(pid=18800): stderr: | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031910053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031910064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031910073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031910073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031910073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:13.258142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18795): Terminating (SIGTERM) 03:19:13.298100 run iperf3-srv_10.42.42.10(pid=18796): Terminating (SIGTERM) 03:19:13.337805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18799): Terminating (SIGTERM) 03:19:13.378093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18802): Terminating (SIGTERM) 03:19:13.418028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18805): Terminating (SIGTERM) 03:19:13.458066 --- ParallelTerminationStrategy: PID 18795 died... 03:19:13.477119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18795): Terminated: ok {rc=0} 03:19:13.521363 --- ParallelTerminationStrategy: PID 18796 died... 03:19:13.539787 run iperf3-srv_10.42.42.10(pid=18796): Terminated {rc=256} 03:19:13.583995 --- ParallelTerminationStrategy: PID 18799 died... 03:19:13.602518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18799): Terminated: ok {rc=0} 03:19:13.647172 --- ParallelTerminationStrategy: PID 18802 died... 03:19:13.665955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18802): Terminated: ok {rc=0} 03:19:13.710708 --- ParallelTerminationStrategy: PID 18805 died... 03:19:13.729704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18805): Terminated: ok {rc=0} 03:19:13.815796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:19:14.962725 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:14.974302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:15.043697 tst iperf3m4.py: using LAC 25623 03:19:15.171395 tst iperf3m4.py: using RAC 123 03:19:15.299170 tst iperf3m4.py: using CellId 25623 03:19:15.429389 tst iperf3m4.py: using BVCI 25624 03:19:15.547708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.559382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.570876 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.582492 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.595934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.607370 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.618986 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.630446 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:15.642140 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:15.759925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:15.886398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:16.009745 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:16.131711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:16.342191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:16.745388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18807): Launched 03:19:17.055107 run iperf3-srv_10.42.42.10(pid=18808): Launched 03:19:17.193586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:19:17.409353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:17.718049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18809): Launched 03:19:17.984674 run iperf3-srv_10.42.42.10(pid=18810): Launched 03:19:18.099934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:19:18.303959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:18.611622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18811): Launched 03:19:18.877928 run iperf3-srv_10.42.42.10(pid=18812): Launched 03:19:18.994282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:19:19.198288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:19.505579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18813): Launched 03:19:19.773827 run iperf3-srv_10.42.42.10(pid=18814): Launched 03:19:19.890265 tst iperf3m4.py:8: start network... 03:19:20.095146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:20.569676 run create_hlr_db(pid=18815): Launched 03:19:20.686892 bus /gobi_6: Setting Powered False 03:19:21.748583 run create_hlr_db(pid=18815): Terminated: ok {rc=0} 03:19:22.194442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18817): Launched 03:19:22.521210 run osmo-hlr_10.42.42.2(pid=18818): Launched 03:19:22.646624 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:23.214542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18820): Launched 03:19:23.541715 run osmo-stp_10.42.42.5(pid=18821): Launched 03:19:23.667145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:24.216827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18823): Launched 03:19:24.333519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:24.605158 run patchelf(pid=18824): Launched 03:19:24.790319 run osmo-stp_10.42.42.5(pid=18821): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18821)] 03:19:24.928030 run osmo-stp_10.42.42.5(pid=18821): stdout: | (launched: 2022-12-10_03:19:23.481870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:25.068117 run osmo-stp_10.42.42.5(pid=18821): stderr: | [0;m[38;5;43m20221210031923681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031923681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031923682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031923682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031923682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031923683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031923683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:25.207215 run osmo-stp_10.42.42.5(pid=18821): stdout: | (launched: 2022-12-10_03:19:23.481870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:25.340913 run osmo-stp_10.42.42.5(pid=18821): stderr: | [0;m[38;5;43m20221210031923681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031923681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031923682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031923682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031923682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031923683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031923683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:25.498724 run patchelf(pid=18824): Terminating (SIGINT) 03:19:25.681632 run patchelf(pid=18824): Terminated: ok {rc=0} 03:19:25.813373 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18821): Process ended prematurely: osmo-stp_10.42.42.5(pid=18821) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18821)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:19:25.823518 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:19:25.852213 run osmo-hlr_10.42.42.2(pid=18818): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18818)] 03:19:25.902287 run osmo-hlr_10.42.42.2(pid=18818): stdout: | (launched: 2022-12-10_03:19:22.461562) 03:19:25.953790 run osmo-hlr_10.42.42.2(pid=18818): stderr: | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031922665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031922678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031922686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031922686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031922686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:26.005869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18807): Terminating (SIGTERM) 03:19:26.047581 run iperf3-srv_10.42.42.10(pid=18808): Terminating (SIGTERM) 03:19:26.089282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18809): Terminating (SIGTERM) 03:19:26.131012 run iperf3-srv_10.42.42.10(pid=18810): Terminating (SIGTERM) 03:19:26.172811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18811): Terminating (SIGTERM) 03:19:26.214804 run iperf3-srv_10.42.42.10(pid=18812): Terminating (SIGTERM) 03:19:26.256351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18813): Terminating (SIGTERM) 03:19:26.298182 run iperf3-srv_10.42.42.10(pid=18814): Terminating (SIGTERM) 03:19:26.339824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18817): Terminating (SIGTERM) 03:19:26.381463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18820): Terminating (SIGTERM) 03:19:26.422962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18823): Terminating (SIGTERM) 03:19:26.464881 --- ParallelTerminationStrategy: PID 18807 died... 03:19:26.485014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18807): Terminated: ok {rc=0} 03:19:26.531177 --- ParallelTerminationStrategy: PID 18808 died... 03:19:26.550782 run iperf3-srv_10.42.42.10(pid=18808): Terminated {rc=256} 03:19:26.596623 --- ParallelTerminationStrategy: PID 18809 died... 03:19:26.616267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18809): Terminated: ok {rc=0} 03:19:26.662067 --- ParallelTerminationStrategy: PID 18810 died... 03:19:26.681572 run iperf3-srv_10.42.42.10(pid=18810): Terminated {rc=256} 03:19:26.727730 --- ParallelTerminationStrategy: PID 18811 died... 03:19:26.747256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18811): Terminated: ok {rc=0} 03:19:26.793232 --- ParallelTerminationStrategy: PID 18812 died... 03:19:26.812853 run iperf3-srv_10.42.42.10(pid=18812): Terminated {rc=256} 03:19:26.858594 --- ParallelTerminationStrategy: PID 18813 died... 03:19:26.878197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18813): Terminated: ok {rc=0} 03:19:26.924027 --- ParallelTerminationStrategy: PID 18814 died... 03:19:26.943584 run iperf3-srv_10.42.42.10(pid=18814): Terminated {rc=256} 03:19:26.989384 --- ParallelTerminationStrategy: PID 18817 died... 03:19:27.008715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18817): Terminated: ok {rc=0} 03:19:27.054757 --- ParallelTerminationStrategy: PID 18820 died... 03:19:27.074467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18820): Terminated: ok {rc=0} 03:19:27.120547 --- ParallelTerminationStrategy: PID 18823 died... 03:19:27.140219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18823): Terminated: ok {rc=0} 03:19:27.228764 bus /gobi_4: Setting Powered False 03:19:28.329957 bus /gobi_4: Setting Powered False 03:19:29.448858 bus /gobi_1: Setting Powered False 03:19:30.550174 bus /gobi_1: Setting Powered False 03:19:31.680302 bus /gobi_0: Setting Powered False 03:19:32.795104 bus /gobi_0: Setting Powered False 03:19:33.915373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:19:35.020022 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.031803 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:35.102163 tst ping.py: using LAC 25624 03:19:35.221209 tst ping.py: using RAC 124 03:19:35.336097 tst ping.py: using CellId 25624 03:19:35.452634 tst ping.py: using BVCI 25625 03:19:35.561032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.572041 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.582837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.593938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.604797 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.615928 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.627021 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:35.637974 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:35.752711 tst ping.py:19: start network... 03:19:35.952594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:36.413665 run create_hlr_db(pid=18825): Launched 03:19:36.528696 bus /gobi_6: Setting Powered False 03:19:37.589317 run create_hlr_db(pid=18825): Terminated: ok {rc=0} 03:19:38.029666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18827): Launched 03:19:38.351839 run osmo-hlr_10.42.42.2(pid=18828): Launched 03:19:38.474359 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:39.027806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18830): Launched 03:19:39.348332 run osmo-stp_10.42.42.5(pid=18831): Launched 03:19:39.469379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:40.023624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18833): Launched 03:19:40.146818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:40.418782 run patchelf(pid=18834): Launched 03:19:40.598254 run osmo-stp_10.42.42.5(pid=18831): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18831)] 03:19:40.733254 run osmo-stp_10.42.42.5(pid=18831): stdout: | (launched: 2022-12-10_03:19:39.289859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:40.870225 run osmo-stp_10.42.42.5(pid=18831): stderr: | [0;m[38;5;43m20221210031939482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031939482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031939483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031939483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:41.007414 run osmo-stp_10.42.42.5(pid=18831): stdout: | (launched: 2022-12-10_03:19:39.289859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:41.138737 run osmo-stp_10.42.42.5(pid=18831): stderr: | [0;m[38;5;43m20221210031939482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031939482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031939483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031939483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031939485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:41.295091 run patchelf(pid=18834): Terminating (SIGINT) 03:19:41.474518 run patchelf(pid=18834): Terminated: ok {rc=0} 03:19:41.604012 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18831): Process ended prematurely: osmo-stp_10.42.42.5(pid=18831) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18831)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 03:19:41.613427 tst ping.py:22: Test FAILED (6.6 sec) 03:19:41.641732 run osmo-hlr_10.42.42.2(pid=18828): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18828)] 03:19:41.692070 run osmo-hlr_10.42.42.2(pid=18828): stdout: | (launched: 2022-12-10_03:19:38.293167) 03:19:41.744077 run osmo-hlr_10.42.42.2(pid=18828): stderr: | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031938492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031938504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031938512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031938512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031938512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:41.796705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18827): Terminating (SIGTERM) 03:19:41.838644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18830): Terminating (SIGTERM) 03:19:41.880910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18833): Terminating (SIGTERM) 03:19:41.923788 --- ParallelTerminationStrategy: PID 18827 died... 03:19:41.943986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18827): Terminated: ok {rc=0} 03:19:41.990511 --- ParallelTerminationStrategy: PID 18830 died... 03:19:42.010513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18830): Terminated: ok {rc=0} 03:19:42.056859 --- ParallelTerminationStrategy: PID 18833 died... 03:19:42.076632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18833): Terminated: ok {rc=0} 03:19:42.164328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:19:43.251989 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.263898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:43.334129 tst ping_idle_ping.py: using LAC 25625 03:19:43.459021 tst ping_idle_ping.py: using RAC 125 03:19:43.585598 tst ping_idle_ping.py: using CellId 25625 03:19:43.708446 tst ping_idle_ping.py: using BVCI 25626 03:19:43.826714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.838381 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.849895 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.861378 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.872734 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.884446 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.896144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.907672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:44.026181 tst ping_idle_ping.py:24: start network... 03:19:44.244866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:44.745690 run create_hlr_db(pid=18835): Launched 03:19:44.872277 bus /gobi_6: Setting Powered False 03:19:45.946505 run create_hlr_db(pid=18835): Terminated: ok {rc=0} 03:19:46.449595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Launched 03:19:46.771316 run osmo-hlr_10.42.42.2(pid=18838): Launched 03:19:46.907476 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:47.666016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Launched 03:19:47.986361 run osmo-stp_10.42.42.5(pid=18841): Launched 03:19:48.108633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:48.662420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18843): Launched 03:19:48.785350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:49.055978 run patchelf(pid=18844): Launched 03:19:49.235681 run osmo-stp_10.42.42.5(pid=18841): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] 03:19:49.371472 run osmo-stp_10.42.42.5(pid=18841): stdout: | (launched: 2022-12-10_03:19:47.927849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:49.509190 run osmo-stp_10.42.42.5(pid=18841): stderr: | [0;m[38;5;43m20221210031948117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031948117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031948118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031948118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031948118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031948119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031948119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:49.646522 run osmo-stp_10.42.42.5(pid=18841): stdout: | (launched: 2022-12-10_03:19:47.927849) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:49.777696 run osmo-stp_10.42.42.5(pid=18841): stderr: | [0;m[38;5;43m20221210031948117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031948117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031948118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031948118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031948118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031948119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031948119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:49.933766 run patchelf(pid=18844): Terminating (SIGINT) 03:19:50.114303 run patchelf(pid=18844): Terminated: ok {rc=0} 03:19:50.244489 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18841): Process ended prematurely: osmo-stp_10.42.42.5(pid=18841) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:19:50.254004 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 03:19:50.282107 run osmo-hlr_10.42.42.2(pid=18838): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18838)] 03:19:50.332083 run osmo-hlr_10.42.42.2(pid=18838): stdout: | (launched: 2022-12-10_03:19:46.709525) 03:19:50.383827 run osmo-hlr_10.42.42.2(pid=18838): stderr: | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031947079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031947097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031947106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031947106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031947106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:50.435816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Terminating (SIGTERM) 03:19:50.477141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Terminating (SIGTERM) 03:19:50.518585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18843): Terminating (SIGTERM) 03:19:50.560481 --- ParallelTerminationStrategy: PID 18837 died... 03:19:50.580657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18837): Terminated: ok {rc=0} 03:19:50.627004 --- ParallelTerminationStrategy: PID 18840 died... 03:19:50.646727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18840): Terminated: ok {rc=0} 03:19:50.692796 --- ParallelTerminationStrategy: PID 18843 died... 03:19:50.712804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18843): Terminated: ok {rc=0} 03:19:50.800236 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:19:52.109112 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:19:52.116359 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:19:52.149660 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 03:19:52.188233 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 03:19:52.273969 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:19:52.305585 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 03:19:52.343493 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 03:19:52.950286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 03:19:53.002231 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.014147 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:19:53.065779 tst cs_paging_gprs_active.py: using LAC 25626 03:19:53.193081 tst cs_paging_gprs_active.py: using RAC 126 03:19:53.318394 tst cs_paging_gprs_active.py: using CellId 25626 03:19:53.443634 tst cs_paging_gprs_active.py: using BVCI 25627 03:19:53.554809 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.566280 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.577572 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.589129 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.600658 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.612553 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.623979 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.635174 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:19:53.646734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:19:53.767904 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:19:53.886978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:19:54.103968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:54.425567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18848): Launched 03:19:54.704087 run iperf3-srv_10.42.42.10(pid=18849): Launched 03:19:54.824841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:19:55.039971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:55.362560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18850): Launched 03:19:55.641315 run iperf3-srv_10.42.42.10(pid=18851): Launched 03:19:55.761951 tst cs_paging_gprs_active.py:38: start network... 03:19:55.976660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:56.476147 run create_hlr_db(pid=18852): Launched 03:19:56.609374 bus /gobi_6: Setting Powered False 03:19:57.673323 run create_hlr_db(pid=18852): Terminated: ok {rc=0} 03:19:58.102807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Launched 03:19:58.405096 run osmo-hlr_10.42.42.2(pid=18855): Launched 03:19:58.522634 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:59.043009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Launched 03:19:59.345061 run osmo-stp_10.42.42.5(pid=18858): Launched 03:19:59.460840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:59.981507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Launched 03:20:00.098929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:00.354272 run patchelf(pid=18861): Launched 03:20:00.522195 run osmo-stp_10.42.42.5(pid=18858): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] 03:20:00.650000 run osmo-stp_10.42.42.5(pid=18858): stdout: | (launched: 2022-12-10_03:19:59.289756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:00.779084 run osmo-stp_10.42.42.5(pid=18858): stderr: | [0;m[38;5;43m20221210031959459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031959460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031959460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031959460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:00.925510 run osmo-stp_10.42.42.5(pid=18858): stdout: | (launched: 2022-12-10_03:19:59.289756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:01.052404 run osmo-stp_10.42.42.5(pid=18858): stderr: | [0;m[38;5;43m20221210031959459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210031959460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210031959460 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210031959460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210031959461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:01.213751 run patchelf(pid=18861): Terminating (SIGINT) 03:20:01.387357 run patchelf(pid=18861): Terminated: ok {rc=0} 03:20:01.551578 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18858): Process ended prematurely: osmo-stp_10.42.42.5(pid=18858) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 03:20:01.566339 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:20:01.600617 run osmo-hlr_10.42.42.2(pid=18855): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18855)] 03:20:01.661687 run osmo-hlr_10.42.42.2(pid=18855): stdout: | (launched: 2022-12-10_03:19:58.349873) 03:20:01.723199 run osmo-hlr_10.42.42.2(pid=18855): stderr: | [0;m[1;31m20221210031958524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210031958524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210031958524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210031958524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210031958525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210031958525 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210031958536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210031958544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210031958545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210031958545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:01.784014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18848): Terminating (SIGTERM) 03:20:01.840157 run iperf3-srv_10.42.42.10(pid=18849): Terminating (SIGTERM) 03:20:01.896552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18850): Terminating (SIGTERM) 03:20:01.947144 run iperf3-srv_10.42.42.10(pid=18851): Terminating (SIGTERM) 03:20:01.998390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Terminating (SIGTERM) 03:20:02.066588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Terminating (SIGTERM) 03:20:02.133864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Terminating (SIGTERM) 03:20:02.201546 --- ParallelTerminationStrategy: PID 18848 died... 03:20:02.235389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18848): Terminated: ok {rc=0} 03:20:02.284789 --- ParallelTerminationStrategy: PID 18849 died... 03:20:02.305410 run iperf3-srv_10.42.42.10(pid=18849): Terminated {rc=256} 03:20:02.354925 --- ParallelTerminationStrategy: PID 18850 died... 03:20:02.375568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18850): Terminated: ok {rc=0} 03:20:02.425187 --- ParallelTerminationStrategy: PID 18851 died... 03:20:02.445715 run iperf3-srv_10.42.42.10(pid=18851): Terminated {rc=256} 03:20:02.493770 --- ParallelTerminationStrategy: PID 18854 died... 03:20:02.514344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18854): Terminated: ok {rc=0} 03:20:02.562516 --- ParallelTerminationStrategy: PID 18857 died... 03:20:02.583406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18857): Terminated: ok {rc=0} 03:20:02.631893 --- ParallelTerminationStrategy: PID 18860 died... 03:20:02.651587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18860): Terminated: ok {rc=0} 03:20:02.739243 bus /gobi_0: Setting Powered False 03:20:03.838675 bus /gobi_0: Setting Powered False 03:20:04.954312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 03:20:06.103949 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.116428 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:06.167804 tst iperf3.py: using LAC 25627 03:20:06.295368 tst iperf3.py: using RAC 127 03:20:06.422848 tst iperf3.py: using CellId 25627 03:20:06.549319 tst iperf3.py: using BVCI 25628 03:20:06.667206 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.679065 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.690741 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.702542 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.714148 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.725728 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.737477 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.749025 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:06.760796 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:06.881550 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:07.096412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:07.419058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Launched 03:20:07.697462 run iperf3-srv_10.42.42.10(pid=18874): Launched 03:20:07.817872 tst iperf3.py:8: start network... 03:20:08.033258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:08.532506 run create_hlr_db(pid=18875): Launched 03:20:08.663675 bus /gobi_6: Setting Powered False 03:20:09.726891 run create_hlr_db(pid=18875): Terminated: ok {rc=0} 03:20:10.174782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18877): Launched 03:20:10.495539 run osmo-hlr_10.42.42.2(pid=18878): Launched 03:20:10.618223 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:11.174428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18880): Launched 03:20:11.495600 run osmo-stp_10.42.42.5(pid=18881): Launched 03:20:11.618379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:12.171791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18883): Launched 03:20:12.295499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:12.582144 run patchelf(pid=18898): Launched 03:20:12.761115 run osmo-stp_10.42.42.5(pid=18881): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18881)] 03:20:12.895315 run osmo-stp_10.42.42.5(pid=18881): stdout: | (launched: 2022-12-10_03:20:11.436552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:13.029690 run osmo-stp_10.42.42.5(pid=18881): stderr: | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032011629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:13.163251 run osmo-stp_10.42.42.5(pid=18881): stdout: | (launched: 2022-12-10_03:20:11.436552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:13.294376 run osmo-stp_10.42.42.5(pid=18881): stderr: | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032011628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032011629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032011629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:13.448764 run patchelf(pid=18898): Terminating (SIGINT) 03:20:13.625814 run patchelf(pid=18898): Terminated: ok {rc=0} 03:20:13.754221 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18881): Process ended prematurely: osmo-stp_10.42.42.5(pid=18881) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18881)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 03:20:13.764802 tst iperf3.py:8: Test FAILED (7.7 sec) 03:20:13.796213 run osmo-hlr_10.42.42.2(pid=18878): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18878)] 03:20:13.847924 run osmo-hlr_10.42.42.2(pid=18878): stdout: | (launched: 2022-12-10_03:20:10.437464) 03:20:13.900573 run osmo-hlr_10.42.42.2(pid=18878): stderr: | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032010636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032010649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032010657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032010658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032010658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:13.954386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Terminating (SIGTERM) 03:20:13.997687 run iperf3-srv_10.42.42.10(pid=18874): Terminating (SIGTERM) 03:20:14.044448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18877): Terminating (SIGTERM) 03:20:14.088307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18880): Terminating (SIGTERM) 03:20:14.133045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18883): Terminating (SIGTERM) 03:20:14.178144 --- ParallelTerminationStrategy: PID 18873 died... 03:20:14.198245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Terminated: ok {rc=0} 03:20:14.248280 --- ParallelTerminationStrategy: PID 18874 died... 03:20:14.267939 run iperf3-srv_10.42.42.10(pid=18874): Terminated {rc=256} 03:20:14.315366 --- ParallelTerminationStrategy: PID 18877 died... 03:20:14.334936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18877): Terminated: ok {rc=0} 03:20:14.380922 --- ParallelTerminationStrategy: PID 18880 died... 03:20:14.399732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18880): Terminated: ok {rc=0} 03:20:14.445837 --- ParallelTerminationStrategy: PID 18883 died... 03:20:14.464483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18883): Terminated: ok {rc=0} 03:20:14.551542 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 03:20:15.701520 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:15.713595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:15.765149 tst iperf3m4.py: using LAC 25628 03:20:15.897341 tst iperf3m4.py: using RAC 128 03:20:16.022393 tst iperf3m4.py: using CellId 25628 03:20:16.149717 tst iperf3m4.py: using BVCI 25629 03:20:16.297291 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.312335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.326334 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.339611 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.352286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.364327 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.376813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.389064 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:16.401609 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:16.545762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:16.698273 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:16.851799 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:16.987778 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:17.194043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:17.501058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19236): Launched 03:20:17.763747 run iperf3-srv_10.42.42.10(pid=19237): Launched 03:20:17.877680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:20:18.078464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:18.380393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19238): Launched 03:20:18.642329 run iperf3-srv_10.42.42.10(pid=19239): Launched 03:20:18.755665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:20:18.956065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:19.256393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Launched 03:20:19.517608 run iperf3-srv_10.42.42.10(pid=19241): Launched 03:20:19.631304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:20:19.832799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:20.145298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Launched 03:20:20.425792 run iperf3-srv_10.42.42.10(pid=19243): Launched 03:20:20.546767 tst iperf3m4.py:8: start network... 03:20:20.763371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:21.262566 run create_hlr_db(pid=19244): Launched 03:20:21.392693 bus /gobi_6: Setting Powered False 03:20:22.456186 run create_hlr_db(pid=19244): Terminated: ok {rc=0} 03:20:22.893745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19259): Launched 03:20:23.225786 run osmo-hlr_10.42.42.2(pid=19339): Launched 03:20:23.355251 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:24.069793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19426): Launched 03:20:24.390146 run osmo-stp_10.42.42.5(pid=19427): Launched 03:20:24.633586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:25.331999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19429): Launched 03:20:25.462629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:25.731256 run patchelf(pid=19430): Launched 03:20:25.917574 run osmo-stp_10.42.42.5(pid=19427): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19427)] 03:20:26.048878 run osmo-stp_10.42.42.5(pid=19427): stdout: | (launched: 2022-12-10_03:20:24.327442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:26.181128 run osmo-stp_10.42.42.5(pid=19427): stderr: | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032024668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:26.314837 run osmo-stp_10.42.42.5(pid=19427): stdout: | (launched: 2022-12-10_03:20:24.327442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:26.443278 run osmo-stp_10.42.42.5(pid=19427): stderr: | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032024668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032024668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032024669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:26.593913 run patchelf(pid=19430): Terminating (SIGINT) 03:20:26.768276 run patchelf(pid=19430): Terminated: ok {rc=0} 03:20:26.893915 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19427): Process ended prematurely: osmo-stp_10.42.42.5(pid=19427) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19427)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 03:20:26.904474 tst iperf3m4.py:8: Test FAILED (11.2 sec) 03:20:26.935814 run osmo-hlr_10.42.42.2(pid=19339): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19339)] 03:20:26.986282 run osmo-hlr_10.42.42.2(pid=19339): stdout: | (launched: 2022-12-10_03:20:23.169179) 03:20:27.039426 run osmo-hlr_10.42.42.2(pid=19339): stderr: | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032023498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032023519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032023527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032023527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032023527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:27.094654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19236): Terminating (SIGTERM) 03:20:27.137273 run iperf3-srv_10.42.42.10(pid=19237): Terminating (SIGTERM) 03:20:27.183267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19238): Terminating (SIGTERM) 03:20:27.227588 run iperf3-srv_10.42.42.10(pid=19239): Terminating (SIGTERM) 03:20:27.273128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Terminating (SIGTERM) 03:20:27.315989 run iperf3-srv_10.42.42.10(pid=19241): Terminating (SIGTERM) 03:20:27.358300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Terminating (SIGTERM) 03:20:27.400823 run iperf3-srv_10.42.42.10(pid=19243): Terminating (SIGTERM) 03:20:27.447290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19259): Terminating (SIGTERM) 03:20:27.490223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19426): Terminating (SIGTERM) 03:20:27.534050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19429): Terminating (SIGTERM) 03:20:27.579958 --- ParallelTerminationStrategy: PID 19236 died... 03:20:27.600006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19236): Terminated: ok {rc=0} 03:20:27.649699 --- ParallelTerminationStrategy: PID 19237 died... 03:20:27.669585 run iperf3-srv_10.42.42.10(pid=19237): Terminated {rc=256} 03:20:27.717108 --- ParallelTerminationStrategy: PID 19238 died... 03:20:27.736722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19238): Terminated: ok {rc=0} 03:20:27.783949 --- ParallelTerminationStrategy: PID 19239 died... 03:20:27.803785 run iperf3-srv_10.42.42.10(pid=19239): Terminated {rc=256} 03:20:27.851942 --- ParallelTerminationStrategy: PID 19240 died... 03:20:27.871790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Terminated: ok {rc=0} 03:20:27.919318 --- ParallelTerminationStrategy: PID 19241 died... 03:20:27.939532 run iperf3-srv_10.42.42.10(pid=19241): Terminated {rc=256} 03:20:27.987882 --- ParallelTerminationStrategy: PID 19242 died... 03:20:28.007985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Terminated: ok {rc=0} 03:20:28.057301 --- ParallelTerminationStrategy: PID 19243 died... 03:20:28.077091 run iperf3-srv_10.42.42.10(pid=19243): Terminated {rc=256} 03:20:28.124927 --- ParallelTerminationStrategy: PID 19259 died... 03:20:28.144646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19259): Terminated: ok {rc=0} 03:20:28.192758 --- ParallelTerminationStrategy: PID 19426 died... 03:20:28.214056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19426): Terminated: ok {rc=0} 03:20:28.262657 --- ParallelTerminationStrategy: PID 19429 died... 03:20:28.282415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19429): Terminated: ok {rc=0} 03:20:28.372065 bus /gobi_4: Setting Powered False 03:20:29.470368 bus /gobi_4: Setting Powered False 03:20:30.583432 bus /gobi_1: Setting Powered False 03:20:31.680040 bus /gobi_1: Setting Powered False 03:20:32.795549 bus /gobi_0: Setting Powered False 03:20:33.894760 bus /gobi_0: Setting Powered False 03:20:35.012110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 03:20:36.115403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.127590 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:36.178547 tst ping.py: using LAC 25629 03:20:36.297294 tst ping.py: using RAC 129 03:20:36.418434 tst ping.py: using CellId 25629 03:20:36.543319 tst ping.py: using BVCI 25630 03:20:36.659282 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.671396 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.683173 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.694981 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.706671 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.718316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.730054 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:36.741679 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:36.855902 tst ping.py:19: start network... 03:20:37.053438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:37.510353 run create_hlr_db(pid=19432): Launched 03:20:37.624051 bus /gobi_6: Setting Powered False 03:20:38.687016 run create_hlr_db(pid=19432): Terminated: ok {rc=0} 03:20:39.126710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19434): Launched 03:20:39.442853 run osmo-hlr_10.42.42.2(pid=19435): Launched 03:20:39.563331 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:40.108659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19437): Launched 03:20:40.426096 run osmo-stp_10.42.42.5(pid=19438): Launched 03:20:40.546752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:41.090894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19440): Launched 03:20:41.212343 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:41.478646 run patchelf(pid=19441): Launched 03:20:41.655851 run osmo-stp_10.42.42.5(pid=19438): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19438)] 03:20:41.790014 run osmo-stp_10.42.42.5(pid=19438): stdout: | (launched: 2022-12-10_03:20:40.368270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:41.925834 run osmo-stp_10.42.42.5(pid=19438): stderr: | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032040563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:42.061646 run osmo-stp_10.42.42.5(pid=19438): stdout: | (launched: 2022-12-10_03:20:40.368270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:42.191717 run osmo-stp_10.42.42.5(pid=19438): stderr: | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032040562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032040563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032040563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:42.345667 run patchelf(pid=19441): Terminating (SIGINT) 03:20:42.523545 run patchelf(pid=19441): Terminated: ok {rc=0} 03:20:42.651671 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19438): Process ended prematurely: osmo-stp_10.42.42.5(pid=19438) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19438)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 03:20:42.661192 tst ping.py:22: Test FAILED (6.5 sec) 03:20:42.689865 run osmo-hlr_10.42.42.2(pid=19435): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19435)] 03:20:42.740114 run osmo-hlr_10.42.42.2(pid=19435): stdout: | (launched: 2022-12-10_03:20:39.385501) 03:20:42.792206 run osmo-hlr_10.42.42.2(pid=19435): stderr: | [0;m[1;31m20221210032039583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032039583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032039583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032039583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032039584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032039596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032039605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032039605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032039605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:42.845074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19434): Terminating (SIGTERM) 03:20:42.887143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19437): Terminating (SIGTERM) 03:20:42.929231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19440): Terminating (SIGTERM) 03:20:42.971405 --- ParallelTerminationStrategy: PID 19434 died... 03:20:42.991566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19434): Terminated: ok {rc=0} 03:20:43.038136 --- ParallelTerminationStrategy: PID 19437 died... 03:20:43.057784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19437): Terminated: ok {rc=0} 03:20:43.104232 --- ParallelTerminationStrategy: PID 19440 died... 03:20:43.124090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19440): Terminated: ok {rc=0} 03:20:43.212030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 03:20:44.300710 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.313257 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:44.365094 tst ping_idle_ping.py: using LAC 25630 03:20:44.483139 tst ping_idle_ping.py: using RAC 130 03:20:44.600855 tst ping_idle_ping.py: using CellId 25630 03:20:44.717216 tst ping_idle_ping.py: using BVCI 25631 03:20:44.824231 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.835708 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.846890 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.858431 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.869839 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.881082 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.892570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.903983 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:45.019955 tst ping_idle_ping.py:24: start network... 03:20:45.219141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:45.682024 run create_hlr_db(pid=19442): Launched 03:20:45.794677 bus /gobi_6: Setting Powered False 03:20:46.882100 run create_hlr_db(pid=19442): Terminated: ok {rc=0} 03:20:47.353999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Launched 03:20:47.672306 run osmo-hlr_10.42.42.2(pid=19445): Launched 03:20:47.793682 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:48.338955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Launched 03:20:48.656151 run osmo-stp_10.42.42.5(pid=19448): Launched 03:20:48.777056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:49.322883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19450): Launched 03:20:49.444196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:49.711252 run patchelf(pid=19451): Launched 03:20:49.888064 run osmo-stp_10.42.42.5(pid=19448): ERR: Terminated: ERROR {rc=1} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] 03:20:50.022472 run osmo-stp_10.42.42.5(pid=19448): stdout: | (launched: 2022-12-10_03:20:48.598469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:50.158575 run osmo-stp_10.42.42.5(pid=19448): stderr: | [0;m[38;5;43m20221210032048790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032048790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032048791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032048791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032048791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032048791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032048792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:50.295016 run osmo-stp_10.42.42.5(pid=19448): stdout: | (launched: 2022-12-10_03:20:48.598469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:50.425494 run osmo-stp_10.42.42.5(pid=19448): stderr: | [0;m[38;5;43m20221210032048790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032048790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032048791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032048791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032048791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032048791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032048792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:50.579673 run patchelf(pid=19451): Terminating (SIGINT) 03:20:50.758144 run patchelf(pid=19451): Terminated: ok {rc=0} 03:20:50.886078 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19448): Process ended prematurely: osmo-stp_10.42.42.5(pid=19448) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 03:20:50.895520 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:20:50.923436 run osmo-hlr_10.42.42.2(pid=19445): ERR: Terminated: ERROR {rc=237} [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19445)] 03:20:50.973263 run osmo-hlr_10.42.42.2(pid=19445): stdout: | (launched: 2022-12-10_03:20:47.614403) 03:20:51.025821 run osmo-hlr_10.42.42.2(pid=19445): stderr: | [0;m[1;31m20221210032047812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032047812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032047812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032047812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032047813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032047813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032047824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032047833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032047833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032047833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:51.078232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Terminating (SIGTERM) 03:20:51.119918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Terminating (SIGTERM) 03:20:51.161786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19450): Terminating (SIGTERM) 03:20:51.204164 --- ParallelTerminationStrategy: PID 19444 died... 03:20:51.224212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19444): Terminated: ok {rc=0} 03:20:51.270961 --- ParallelTerminationStrategy: PID 19447 died... 03:20:51.290504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19447): Terminated: ok {rc=0} 03:20:51.336480 --- ParallelTerminationStrategy: PID 19450 died... 03:20:51.356107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19450): Terminated: ok {rc=0} 03:20:51.443250 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:20:52.756726 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:20:52.764518 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:20:52.798764 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:20:52.833577 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:20:52.887179 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:20:52.919735 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:20:52.954176 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:20:53.516461 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2368 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:20:53.522778 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:53.535425 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:20:53.604571 tst switch_tch_pdch.py: using LAC 25631 03:20:53.722578 tst switch_tch_pdch.py: using RAC 131 03:20:53.841358 tst switch_tch_pdch.py: using CellId 25631 03:20:53.956473 tst switch_tch_pdch.py: using BVCI 25632 03:20:54.064282 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.075902 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.087309 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.099066 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.110594 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.122093 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.133773 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:20:54.145412 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:20:54.266442 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:20:54.383455 tst switch_tch_pdch.py:51: start network... 03:20:54.581768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:55.036465 run create_hlr_db(pid=19455): Launched 03:20:55.149191 bus /gobi_6: Setting Powered False 03:20:56.207904 run create_hlr_db(pid=19455): Terminated: ok {rc=0} 03:20:56.619676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19457): Launched 03:20:56.914119 run osmo-hlr_10.42.42.2(pid=19458): Launched 03:20:57.026052 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:57.533057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19460): Launched 03:20:57.828377 run osmo-stp_10.42.42.5(pid=19461): Launched 03:20:57.941948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:58.453315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19463): Launched 03:20:58.567827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:58.818838 run patchelf(pid=19464): Launched 03:20:58.984773 run osmo-stp_10.42.42.5(pid=19461): ERR: Terminated: ERROR {rc=1} [trial-2368↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19461)] 03:20:59.110362 run osmo-stp_10.42.42.5(pid=19461): stdout: | (launched: 2022-12-10_03:20:57.774226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:59.238138 run osmo-stp_10.42.42.5(pid=19461): stderr: | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032057942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:59.365515 run osmo-stp_10.42.42.5(pid=19461): stdout: | (launched: 2022-12-10_03:20:57.774226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:59.487132 run osmo-stp_10.42.42.5(pid=19461): stderr: | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032057942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032057942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032057943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:59.631246 run patchelf(pid=19464): Terminating (SIGINT) 03:20:59.797385 run patchelf(pid=19464): Terminated: ok {rc=0} 03:20:59.917240 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19461): Process ended prematurely: osmo-stp_10.42.42.5(pid=19461) [trial-2368↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19461)] [trial-2368↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:20:59.926045 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 03:20:59.952814 run osmo-hlr_10.42.42.2(pid=19458): ERR: Terminated: ERROR {rc=237} [trial-2368↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19458)] 03:21:00.000783 run osmo-hlr_10.42.42.2(pid=19458): stdout: | (launched: 2022-12-10_03:20:56.860121) 03:21:00.050355 run osmo-hlr_10.42.42.2(pid=19458): stderr: | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032057035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032057048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032057056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032057056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032057056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:00.100184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19457): Terminating (SIGTERM) 03:21:00.140158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19460): Terminating (SIGTERM) 03:21:00.180099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19463): Terminating (SIGTERM) 03:21:00.220140 --- ParallelTerminationStrategy: PID 19457 died... 03:21:00.239159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19457): Terminated: ok {rc=0} 03:21:00.283960 --- ParallelTerminationStrategy: PID 19460 died... 03:21:00.302406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19460): Terminated: ok {rc=0} 03:21:00.346266 --- ParallelTerminationStrategy: PID 19463 died... 03:21:00.364676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19463): Terminated: ok {rc=0} 03:21:00.451168 bus /gobi_0: Setting Powered False 03:21:01.557694 bus /gobi_0: Setting Powered False 03:21:02.689700 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2368 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 nitb_smpp --------------------------------------------------------------------- 03:21:03.947665 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:03.951811 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 03:21:03.974246 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 03:21:03.982101 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 03:21:04.019657 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 03:21:04.040336 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 03:21:04.047934 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 03:21:04.565155 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2368 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:04.570365 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:04.593355 tst esme_connect_policy_acceptall.py: using MSISDN 7520 03:21:04.726040 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:05.290165 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19470): Launched 03:21:05.592147 run osmo-nitb_10.42.42.2(pid=19471): Launched 03:21:05.760060 run osmo-nitb_10.42.42.2(pid=19471): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19471)] 03:21:05.895842 run osmo-nitb_10.42.42.2(pid=19471): stdout: | (launched: 2022-12-10_03:21:05.536828) 03:21:06.033209 run osmo-nitb_10.42.42.2(pid=19471): stderr: | (launched: 2022-12-10_03:21:05.581822) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:06.170163 run osmo-nitb_10.42.42.2(pid=19471): stdout: | (launched: 2022-12-10_03:21:05.536828) 03:21:06.301980 run osmo-nitb_10.42.42.2(pid=19471): stderr: | (launched: 2022-12-10_03:21:05.581822) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19471) [trial-2368↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19471)] 03:21:06.707078 tst osmo-nitb_10.42.42.2(pid=19471): stdout: | (launched: 2022-12-10_03:21:05.536828) 03:21:06.829517 tst osmo-nitb_10.42.42.2(pid=19471): stderr: | (launched: 2022-12-10_03:21:05.581822) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:06.973300 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=19471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19471) [trial-2368↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19471)] [trial-2368↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 03:21:06.981702 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 03:21:06.988227 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19470): Terminating (SIGTERM) 03:21:07.197437 --- ParallelTerminationStrategy: PID 19470 died... 03:21:07.217779 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19470): Terminated: ok {rc=0} ---------------------------------------------- trial-2368 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:07.266941 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:07.286268 tst esme_connect_policy_closed.py: using MSISDN 7521 03:21:07.407305 tst esme_connect_policy_closed.py: using MSISDN 7522 03:21:07.516610 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:08.081845 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19472): Launched 03:21:08.385254 run osmo-nitb_10.42.42.2(pid=19473): Launched 03:21:08.548255 run osmo-nitb_10.42.42.2(pid=19473): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19473)] 03:21:08.673540 run osmo-nitb_10.42.42.2(pid=19473): stdout: | (launched: 2022-12-10_03:21:08.330094) 03:21:08.799826 run osmo-nitb_10.42.42.2(pid=19473): stderr: | (launched: 2022-12-10_03:21:08.374922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:08.926144 run osmo-nitb_10.42.42.2(pid=19473): stdout: | (launched: 2022-12-10_03:21:08.330094) 03:21:09.046570 run osmo-nitb_10.42.42.2(pid=19473): stderr: | (launched: 2022-12-10_03:21:08.374922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:09.191253 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=19473): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19473) [trial-2368↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19473)] [trial-2368↪nitb_smpp↪esme_connect_policy_closed.py:24] 03:21:09.199478 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 03:21:09.205906 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19472): Terminating (SIGTERM) 03:21:09.414680 --- ParallelTerminationStrategy: PID 19472 died... 03:21:09.435253 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19472): Terminated: ok {rc=0} ---------------------------------------------- trial-2368 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:21:09.483745 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:09.494766 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:09.540669 tst esme_ms_sms_storeforward.py: using LAC 25632 03:21:09.668310 tst esme_ms_sms_storeforward.py: using RAC 132 03:21:09.788778 tst esme_ms_sms_storeforward.py: using CellId 25632 03:21:09.915733 tst esme_ms_sms_storeforward.py: using BVCI 25633 03:21:10.033256 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:10.157981 tst esme_ms_sms_storeforward.py: using MSISDN 7523 03:21:10.269847 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 03:21:10.473373 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:11.092523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19474): Launched 03:21:11.397321 run osmo-nitb_10.42.42.2(pid=19475): Launched 03:21:11.561902 run osmo-nitb_10.42.42.2(pid=19475): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19475)] 03:21:11.687464 run osmo-nitb_10.42.42.2(pid=19475): stdout: | (launched: 2022-12-10_03:21:11.340857) 03:21:11.814449 run osmo-nitb_10.42.42.2(pid=19475): stderr: | (launched: 2022-12-10_03:21:11.386353) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:11.941790 run osmo-nitb_10.42.42.2(pid=19475): stdout: | (launched: 2022-12-10_03:21:11.340857) 03:21:12.062596 run osmo-nitb_10.42.42.2(pid=19475): stderr: | (launched: 2022-12-10_03:21:11.386353) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:12.207730 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=19475): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19475) [trial-2368↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19475)] [trial-2368↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 03:21:12.215996 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 03:21:12.222475 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19474): Terminating (SIGTERM) 03:21:12.431915 --- ParallelTerminationStrategy: PID 19474 died... 03:21:12.453236 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19474): Terminated: ok {rc=0} 03:21:12.540706 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:21:13.628731 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:13.639988 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:13.676651 tst esme_ms_sms_transaction.py: using LAC 25633 03:21:13.798510 tst esme_ms_sms_transaction.py: using RAC 133 03:21:13.919733 tst esme_ms_sms_transaction.py: using CellId 25633 03:21:14.040882 tst esme_ms_sms_transaction.py: using BVCI 25634 03:21:14.151266 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:14.279528 tst esme_ms_sms_transaction.py: using MSISDN 7524 03:21:14.398150 tst esme_ms_sms_transaction.py:18: start nitb and bts... 03:21:14.616840 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:15.272471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19476): Launched 03:21:15.595479 run osmo-nitb_10.42.42.2(pid=19477): Launched 03:21:15.780060 run osmo-nitb_10.42.42.2(pid=19477): ERR: Terminated: ERROR {rc=2} [trial-2368↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19477)] 03:21:15.950548 run osmo-nitb_10.42.42.2(pid=19477): stdout: | (launched: 2022-12-10_03:21:15.537017) 03:21:16.093278 run osmo-nitb_10.42.42.2(pid=19477): stderr: | (launched: 2022-12-10_03:21:15.585108) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:16.236122 run osmo-nitb_10.42.42.2(pid=19477): stdout: | (launched: 2022-12-10_03:21:15.537017) 03:21:16.373124 run osmo-nitb_10.42.42.2(pid=19477): stderr: | (launched: 2022-12-10_03:21:15.585108) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f01b45da268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19477) [trial-2368↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19477)] 03:21:16.722761 tst osmo-nitb_10.42.42.2(pid=19477): stdout: | (launched: 2022-12-10_03:21:15.537017) 03:21:16.856556 tst osmo-nitb_10.42.42.2(pid=19477): stderr: | (launched: 2022-12-10_03:21:15.585108) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:17.012761 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=19477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19477) [trial-2368↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19477)] [trial-2368↪nitb_smpp↪esme_ms_sms_transaction.py:21] 03:21:17.022159 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 03:21:17.029451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19476): Terminating (SIGTERM) 03:21:17.240244 --- ParallelTerminationStrategy: PID 19476 died... 03:21:17.261800 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19476): Terminated: ok {rc=0} 03:21:17.350305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 smpp --------------------------------------------------------------------- 03:21:18.515058 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:18.518997 tst smpp: Verifying 1 x bts (candidates: 11) 03:21:18.540743 tst smpp: Verifying 6 x ip_address (candidates: 9) 03:21:18.567773 tst smpp: Verifying 1 x modem (candidates: 12) 03:21:18.604892 tst smpp: Reserving 1 x bts (candidates: 11) 03:21:18.626638 tst smpp: Reserving 6 x ip_address (candidates: 9) 03:21:18.654110 tst smpp: Reserving 1 x modem (candidates: 12) 03:21:19.180085 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:19.185513 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:19.196213 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:19.207043 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:19.217958 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:19.236917 tst esme_connect_policy_acceptall.py: using MSISDN 7525 03:21:19.349624 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:19.866089 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19481): Launched 03:21:20.169132 run osmo-stp_10.42.42.4(pid=19482): Launched 03:21:20.285929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:20.754409 run create_hlr_db(pid=19483): Launched 03:21:20.870245 bus /sierra_2: Setting Powered False 03:21:21.930052 run create_hlr_db(pid=19483): Terminated: ok {rc=0} 03:21:22.372084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19485): Launched 03:21:22.695745 run osmo-hlr_10.42.42.2(pid=19486): Launched 03:21:22.819649 run osmo-msc_10.42.42.5: Starting osmo-msc 03:21:23.407409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19488): Launched 03:21:23.729955 run osmo-msc_10.42.42.5(pid=19489): Launched 03:21:23.910159 run osmo-hlr_10.42.42.2(pid=19486): ERR: Terminated: ERROR {rc=237} [trial-2368↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19486)] 03:21:24.047954 run osmo-hlr_10.42.42.2(pid=19486): stdout: | (launched: 2022-12-10_03:21:22.636920) 03:21:24.219902 run osmo-hlr_10.42.42.2(pid=19486): stderr: | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032122856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:24.357273 run osmo-hlr_10.42.42.2(pid=19486): stdout: | (launched: 2022-12-10_03:21:22.636920) 03:21:24.486677 run osmo-hlr_10.42.42.2(pid=19486): stderr: | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032122838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032122856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032122865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:24.641467 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=19486): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19486) [trial-2368↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19486)] [trial-2368↪smpp↪esme_connect_policy_acceptall.py:23] 03:21:24.650385 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 03:21:24.678022 run osmo-msc_10.42.42.5(pid=19489): ERR: Terminated: ERROR {rc=9} [trial-2368↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19489)] 03:21:24.729541 run osmo-msc_10.42.42.5(pid=19489): stdout: | (launched: 2022-12-10_03:21:23.671350) 03:21:24.782134 run osmo-msc_10.42.42.5(pid=19489): stderr: | [0;m[38;5;43m20221210032124036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210032124036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210032124036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210032124036 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210032124036 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210032124037 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210032124037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210032124037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210032124037 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:21:24.834862 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19481): Terminating (SIGTERM) 03:21:24.876729 run osmo-stp_10.42.42.4(pid=19482): Terminating (SIGTERM) 03:21:24.918651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19485): Terminating (SIGTERM) 03:21:24.962650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19488): Terminating (SIGTERM) 03:21:25.008464 --- ParallelTerminationStrategy: PID 19481 died... 03:21:25.029345 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19481): Terminated: ok {rc=0} 03:21:25.078318 --- ParallelTerminationStrategy: PID 19482 died... 03:21:25.098091 run osmo-stp_10.42.42.4(pid=19482): Terminated: ok {rc=0} 03:21:25.144163 --- ParallelTerminationStrategy: PID 19485 died... 03:21:25.163790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19485): Terminated: ok {rc=0} 03:21:25.210080 --- ParallelTerminationStrategy: PID 19488 died... 03:21:25.229806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19488): Terminated: ok {rc=0} ---------------------------------------------- trial-2368 smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:25.280759 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:25.292073 tst smpp: Using 1 x bts (candidates: 1) 03:21:25.328254 tst esme_connect_policy_closed.py: using LAC 25634 03:21:25.459372 tst esme_connect_policy_closed.py: using RAC 134 03:21:25.588041 tst esme_connect_policy_closed.py: using CellId 25634 03:21:25.716132 tst esme_connect_policy_closed.py: using BVCI 25635 03:21:25.833664 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:25.844422 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:25.855138 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:25.875288 tst esme_connect_policy_closed.py: using MSISDN 7526 03:21:25.995336 tst esme_connect_policy_closed.py: using MSISDN 7527 03:21:26.106387 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:26.620887 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19492): Launched 03:21:26.922992 run osmo-stp_10.42.42.4(pid=19493): Launched 03:21:27.039642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:27.507870 run create_hlr_db(pid=19494): Launched 03:21:28.679045 run create_hlr_db(pid=19494): Terminated: ok {rc=0} 03:21:28.999911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19496): Launched 03:21:29.302966 run osmo-hlr_10.42.42.2(pid=19497): Launched 03:21:29.419427 run osmo-msc_10.42.42.5: Starting osmo-msc 03:21:29.980135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19499): Launched 03:21:30.285429 run osmo-msc_10.42.42.5(pid=19500): Launched 03:21:30.456091 run osmo-hlr_10.42.42.2(pid=19497): ERR: Terminated: ERROR {rc=237} [trial-2368↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19497)] 03:21:30.590359 run osmo-hlr_10.42.42.2(pid=19497): stdout: | (launched: 2022-12-10_03:21:29.247806) 03:21:30.721480 run osmo-hlr_10.42.42.2(pid=19497): stderr: | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032129437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032129446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032129447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032129447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:30.862539 run osmo-hlr_10.42.42.2(pid=19497): stdout: | (launched: 2022-12-10_03:21:29.247806) 03:21:31.014423 run osmo-hlr_10.42.42.2(pid=19497): stderr: | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032129422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032129423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032129437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032129446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032129447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032129447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:31.175826 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=19497): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19497) [trial-2368↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19497)] [trial-2368↪smpp↪esme_connect_policy_closed.py:31] 03:21:31.185358 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 03:21:31.215538 run osmo-msc_10.42.42.5(pid=19500): ERR: Terminated: ERROR {rc=9} [trial-2368↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19500)] 03:21:31.268142 run osmo-msc_10.42.42.5(pid=19500): stdout: | (launched: 2022-12-10_03:21:30.229840) 03:21:31.322483 run osmo-msc_10.42.42.5(pid=19500): stderr: | [0;m[38;5;43m20221210032130548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210032130548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210032130548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210032130548 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210032130548 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210032130548 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210032130548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210032130549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210032130549 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:21:31.377577 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19492): Terminating (SIGTERM) 03:21:31.423176 run osmo-stp_10.42.42.4(pid=19493): Terminating (SIGTERM) 03:21:31.472813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19496): Terminating (SIGTERM) 03:21:31.517244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19499): Terminating (SIGTERM) 03:21:31.605441 --- ParallelTerminationStrategy: PID 19492 died... 03:21:31.652502 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19492): Terminated: ok {rc=0} 03:21:31.705645 --- ParallelTerminationStrategy: PID 19493 died... 03:21:31.726158 run osmo-stp_10.42.42.4(pid=19493): Terminated: ok {rc=0} 03:21:31.774380 --- ParallelTerminationStrategy: PID 19496 died... 03:21:31.794632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19496): Terminated: ok {rc=0} 03:21:31.843925 --- ParallelTerminationStrategy: PID 19499 died... 03:21:31.864861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19499): Terminated: ok {rc=0} ---------------------------------------------- trial-2368 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:21:31.918483 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:31.930588 tst smpp: Using 1 x bts (candidates: 1) 03:21:31.968562 tst esme_ms_sms_storeforward.py: using LAC 25635 03:21:32.091589 tst esme_ms_sms_storeforward.py: using RAC 135 03:21:32.217293 tst esme_ms_sms_storeforward.py: using CellId 25635 03:21:32.345486 tst esme_ms_sms_storeforward.py: using BVCI 25636 03:21:32.464854 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:32.475889 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:32.486715 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:32.497524 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:32.508084 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:32.518859 tst smpp: Using 1 x modem (candidates: 1) 03:21:32.644330 tst esme_ms_sms_storeforward.py: using MSISDN 7528 03:21:32.755721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:33.227545 run create_hlr_db(pid=19503): Launched 03:21:34.398425 run create_hlr_db(pid=19503): Terminated: ok {rc=0} 03:21:34.719279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Launched 03:21:35.024611 run osmo-hlr_10.42.42.2(pid=19506): Launched 03:21:35.141386 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:35.666868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Launched 03:21:35.971187 run osmo-stp_10.42.42.5(pid=19509): Launched 03:21:36.087781 run osmo-msc_10.42.42.6: Starting osmo-msc 03:21:36.635306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Launched 03:21:36.939287 run osmo-msc_10.42.42.6(pid=19512): Launched 03:21:37.109138 run osmo-stp_10.42.42.5(pid=19509): ERR: Terminated: ERROR {rc=1} [trial-2368↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] 03:21:37.238270 run osmo-stp_10.42.42.5(pid=19509): stdout: | (launched: 2022-12-10_03:21:35.915810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:37.367397 run osmo-stp_10.42.42.5(pid=19509): stderr: | [0;m[38;5;43m20221210032136086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032136087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032136087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032136087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:37.494406 run osmo-stp_10.42.42.5(pid=19509): stdout: | (launched: 2022-12-10_03:21:35.915810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:37.615165 run osmo-stp_10.42.42.5(pid=19509): stderr: | [0;m[38;5;43m20221210032136086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032136087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032136087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032136087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032136088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:37.759441 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=19509): Process ended prematurely: osmo-stp_10.42.42.5(pid=19509) [trial-2368↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] [trial-2368↪smpp↪esme_ms_sms_storeforward.py:30] 03:21:37.767790 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.8 sec) 03:21:37.793977 run osmo-hlr_10.42.42.2(pid=19506): ERR: Terminated: ERROR {rc=237} [trial-2368↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19506)] 03:21:37.842446 run osmo-hlr_10.42.42.2(pid=19506): stdout: | (launched: 2022-12-10_03:21:34.968798) 03:21:37.891732 run osmo-hlr_10.42.42.2(pid=19506): stderr: | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032135143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032135160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032135170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032135170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032135170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:37.961056 run osmo-msc_10.42.42.6(pid=19512): ERR: Terminated: ERROR {rc=2} [trial-2368↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19512)] 03:21:38.008846 run osmo-msc_10.42.42.6(pid=19512): stdout: | (launched: 2022-12-10_03:21:36.884351) 03:21:38.058409 run osmo-msc_10.42.42.6(pid=19512): stderr: | [0;m[38;5;43m20221210032137156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032137156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa870fbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032137156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032137156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032137157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032137157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032137159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032137159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032137159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032137159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:21:38.108459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Terminating (SIGTERM) 03:21:38.148347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Terminating (SIGTERM) 03:21:38.188404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Terminating (SIGTERM) 03:21:38.228675 --- ParallelTerminationStrategy: PID 19505 died... 03:21:38.247886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19505): Terminated: ok {rc=0} 03:21:38.292316 --- ParallelTerminationStrategy: PID 19508 died... 03:21:38.311044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19508): Terminated: ok {rc=0} 03:21:38.355348 --- ParallelTerminationStrategy: PID 19511 died... 03:21:38.374031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19511): Terminated: ok {rc=0} 03:21:38.459919 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:21:39.548749 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:39.560015 tst smpp: Using 1 x bts (candidates: 1) 03:21:39.598315 tst esme_ms_sms_transaction.py: using LAC 25636 03:21:39.719099 tst esme_ms_sms_transaction.py: using RAC 136 03:21:39.844494 tst esme_ms_sms_transaction.py: using CellId 25636 03:21:39.972688 tst esme_ms_sms_transaction.py: using BVCI 25637 03:21:40.091665 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.102583 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.113236 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.124087 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.134827 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.145543 tst smpp: Using 1 x modem (candidates: 1) 03:21:40.275521 tst esme_ms_sms_transaction.py: using MSISDN 7529 03:21:40.387559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:40.858716 run create_hlr_db(pid=19514): Launched 03:21:40.975197 bus /sierra_2: Setting Powered False 03:21:42.035997 run create_hlr_db(pid=19514): Terminated: ok {rc=0} 03:21:42.481688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Launched 03:21:42.807702 run osmo-hlr_10.42.42.2(pid=19517): Launched 03:21:42.933153 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:43.489585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Launched 03:21:43.813635 run osmo-stp_10.42.42.5(pid=19520): Launched 03:21:43.937907 run osmo-msc_10.42.42.6: Starting osmo-msc 03:21:44.526094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19522): Launched 03:21:44.849930 run osmo-msc_10.42.42.6(pid=19523): Launched 03:21:45.031122 run osmo-stp_10.42.42.5(pid=19520): ERR: Terminated: ERROR {rc=1} [trial-2368↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] 03:21:45.167811 run osmo-stp_10.42.42.5(pid=19520): stdout: | (launched: 2022-12-10_03:21:43.754990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:45.305938 run osmo-stp_10.42.42.5(pid=19520): stderr: | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032143949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:45.442562 run osmo-stp_10.42.42.5(pid=19520): stdout: | (launched: 2022-12-10_03:21:43.754990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:45.571560 run osmo-stp_10.42.42.5(pid=19520): stderr: | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032143948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032143949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032143949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:45.725733 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=19520): Process ended prematurely: osmo-stp_10.42.42.5(pid=19520) [trial-2368↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] [trial-2368↪smpp↪esme_ms_sms_transaction.py:28] 03:21:45.734616 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 03:21:45.761939 run osmo-hlr_10.42.42.2(pid=19517): ERR: Terminated: ERROR {rc=237} [trial-2368↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19517)] 03:21:45.812122 run osmo-hlr_10.42.42.2(pid=19517): stdout: | (launched: 2022-12-10_03:21:42.748899) 03:21:45.871781 run osmo-hlr_10.42.42.2(pid=19517): stderr: | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032142948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032142960 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032142969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032142969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032142969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:45.962444 run osmo-msc_10.42.42.6(pid=19523): ERR: Terminated: ERROR {rc=2} [trial-2368↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19523)] 03:21:46.027220 run osmo-msc_10.42.42.6(pid=19523): stdout: | (launched: 2022-12-10_03:21:44.791369) 03:21:46.080376 run osmo-msc_10.42.42.6(pid=19523): stderr: | [0;m[38;5;43m20221210032145113 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032145114 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2edd857c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032145114 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032145114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032145114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032145114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032145116 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032145116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032145116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032145117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:21:46.133899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Terminating (SIGTERM) 03:21:46.177089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Terminating (SIGTERM) 03:21:46.220192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19522): Terminating (SIGTERM) 03:21:46.264882 --- ParallelTerminationStrategy: PID 19516 died... 03:21:46.285513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Terminated: ok {rc=0} 03:21:46.333217 --- ParallelTerminationStrategy: PID 19519 died... 03:21:46.353182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Terminated: ok {rc=0} 03:21:46.400895 --- ParallelTerminationStrategy: PID 19522 died... 03:21:46.421184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19522): Terminated: ok {rc=0} 03:21:46.510841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 encryption --------------------------------------------------------------------- 03:21:47.708796 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:47.711719 tst encryption: Verifying 1 x bts (candidates: 11) 03:21:47.732809 tst encryption: Verifying 6 x ip_address (candidates: 9) 03:21:47.759887 tst encryption: Verifying 1 x modem (candidates: 12) 03:21:47.794929 tst encryption: Reserving 1 x bts (candidates: 11) 03:21:47.816668 tst encryption: Reserving 6 x ip_address (candidates: 9) 03:21:47.844213 tst encryption: Reserving 1 x modem (candidates: 12) 03:21:48.371856 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2368 encryption register_a5_0_authopt.py ---------------------------------------------- 03:21:48.423754 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:48.434461 tst encryption: Using 1 x bts (candidates: 1) 03:21:48.469390 tst register_a5_0_authopt.py: using LAC 25637 03:21:48.594187 tst register_a5_0_authopt.py: using RAC 137 03:21:48.717814 tst register_a5_0_authopt.py: using CellId 25637 03:21:48.838759 tst register_a5_0_authopt.py: using BVCI 25638 03:21:48.953294 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:48.964036 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:48.974607 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:48.985352 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:48.995968 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:49.006826 tst encryption: Using 1 x modem (candidates: 1) 03:21:49.125128 tst register_a5_0_authopt.py:8: start network... 03:21:49.347764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:49.854690 run create_hlr_db(pid=19528): Launched 03:21:49.988228 bus /sierra_2: Setting Powered False 03:21:51.053164 run create_hlr_db(pid=19528): Terminated: ok {rc=0} 03:21:51.508048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19530): Launched 03:21:51.835255 run osmo-hlr_10.42.42.2(pid=19531): Launched 03:21:51.961209 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:52.524553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19533): Launched 03:21:52.850672 run osmo-stp_10.42.42.5(pid=19534): Launched 03:21:52.976125 run osmo-msc_10.42.42.6: Starting osmo-msc 03:21:53.564414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19536): Launched 03:21:53.890616 run osmo-msc_10.42.42.6(pid=19537): Launched 03:21:54.073124 run osmo-stp_10.42.42.5(pid=19534): ERR: Terminated: ERROR {rc=1} [trial-2368↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19534)] 03:21:54.214968 run osmo-stp_10.42.42.5(pid=19534): stdout: | (launched: 2022-12-10_03:21:52.791535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:54.353948 run osmo-stp_10.42.42.5(pid=19534): stderr: | [0;m[38;5;43m20221210032152983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032152983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032152984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032152984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:54.491637 run osmo-stp_10.42.42.5(pid=19534): stdout: | (launched: 2022-12-10_03:21:52.791535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:54.620884 run osmo-stp_10.42.42.5(pid=19534): stderr: | [0;m[38;5;43m20221210032152983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032152983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032152984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032152984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032152985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:54.776635 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19534): Process ended prematurely: osmo-stp_10.42.42.5(pid=19534) [trial-2368↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19534)] [trial-2368↪encryption↪register_a5_0_authopt.py:8] 03:21:54.786009 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 03:21:54.813312 run osmo-hlr_10.42.42.2(pid=19531): ERR: Terminated: ERROR {rc=237} [trial-2368↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19531)] 03:21:54.862993 run osmo-hlr_10.42.42.2(pid=19531): stdout: | (launched: 2022-12-10_03:21:51.775861) 03:21:54.914977 run osmo-hlr_10.42.42.2(pid=19531): stderr: | [0;m[1;31m20221210032151975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032151975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032151975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032151975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032151976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032151976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032151988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032151996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032151996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032151996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:54.987225 run osmo-msc_10.42.42.6(pid=19537): ERR: Terminated: ERROR {rc=2} [trial-2368↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19537)] 03:21:55.037231 run osmo-msc_10.42.42.6(pid=19537): stdout: | (launched: 2022-12-10_03:21:53.831385) 03:21:55.088485 run osmo-msc_10.42.42.6(pid=19537): stderr: | [0;m[38;5;43m20221210032154157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032154157 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f811407ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032154157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032154157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032154158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032154158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032154159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032154160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:21:55.140029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19530): Terminating (SIGTERM) 03:21:55.181541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19533): Terminating (SIGTERM) 03:21:55.223077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19536): Terminating (SIGTERM) 03:21:55.265153 --- ParallelTerminationStrategy: PID 19530 died... 03:21:55.284678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19530): Terminated: ok {rc=0} 03:21:55.330419 --- ParallelTerminationStrategy: PID 19533 died... 03:21:55.349846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19533): Terminated: ok {rc=0} 03:21:55.395359 --- ParallelTerminationStrategy: PID 19536 died... 03:21:55.414966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19536): Terminated: ok {rc=0} 03:21:55.502263 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 encryption register_a5_0_authreq.py ---------------------------------------------- 03:21:56.654098 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:56.665540 tst encryption: Using 1 x bts (candidates: 1) 03:21:56.702620 tst register_a5_0_authreq.py: using LAC 25638 03:21:56.832619 tst register_a5_0_authreq.py: using RAC 138 03:21:56.964216 tst register_a5_0_authreq.py: using CellId 25638 03:21:57.094854 tst register_a5_0_authreq.py: using BVCI 25639 03:21:57.213638 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.224775 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.235978 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.246717 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.257484 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.268068 tst encryption: Using 1 x modem (candidates: 1) 03:21:57.382800 tst register_a5_0_authreq.py:8: start network... 03:21:57.590904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:58.064291 run create_hlr_db(pid=19539): Launched 03:21:58.183365 bus /sierra_2: Setting Powered False 03:21:59.244079 run create_hlr_db(pid=19539): Terminated: ok {rc=0} 03:21:59.691015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19541): Launched 03:22:00.019932 run osmo-hlr_10.42.42.2(pid=19542): Launched 03:22:00.146178 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:00.714499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19544): Launched 03:22:01.092861 run osmo-stp_10.42.42.5(pid=19545): Launched 03:22:01.402947 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:02.205722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19547): Launched 03:22:02.522919 run osmo-msc_10.42.42.6(pid=19548): Launched 03:22:02.696733 run osmo-stp_10.42.42.5(pid=19545): ERR: Terminated: ERROR {rc=1} [trial-2368↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19545)] 03:22:02.828006 run osmo-stp_10.42.42.5(pid=19545): stdout: | (launched: 2022-12-10_03:22:01.013495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:02.958839 run osmo-stp_10.42.42.5(pid=19545): stderr: | [0;m[38;5;43m20221210032201314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032201316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032201317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032201319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:03.087618 run osmo-stp_10.42.42.5(pid=19545): stdout: | (launched: 2022-12-10_03:22:01.013495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:03.209108 run osmo-stp_10.42.42.5(pid=19545): stderr: | [0;m[38;5;43m20221210032201314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032201316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032201317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032201319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032201322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:03.355594 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19545): Process ended prematurely: osmo-stp_10.42.42.5(pid=19545) [trial-2368↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19545)] [trial-2368↪encryption↪register_a5_0_authreq.py:8] 03:22:03.364491 tst register_a5_0_authreq.py:8: Test FAILED (6.8 sec) 03:22:03.391208 run osmo-hlr_10.42.42.2(pid=19542): ERR: Terminated: ERROR {rc=237} [trial-2368↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19542)] 03:22:03.438761 run osmo-hlr_10.42.42.2(pid=19542): stdout: | (launched: 2022-12-10_03:21:59.959409) 03:22:03.488237 run osmo-hlr_10.42.42.2(pid=19542): stderr: | [0;m[1;31m20221210032200159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032200160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032200160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032200160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032200160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032200160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032200175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032200184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032200185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032200185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:03.557489 run osmo-msc_10.42.42.6(pid=19548): ERR: Terminated: ERROR {rc=2} [trial-2368↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19548)] 03:22:03.605421 run osmo-msc_10.42.42.6(pid=19548): stdout: | (launched: 2022-12-10_03:22:02.466598) 03:22:03.655092 run osmo-msc_10.42.42.6(pid=19548): stderr: | [0;m[38;5;43m20221210032202739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032202739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd4446fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032202739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032202739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032202739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032202739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032202741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032202741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032202742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032202742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:03.705042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19541): Terminating (SIGTERM) 03:22:03.744977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19544): Terminating (SIGTERM) 03:22:03.785749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19547): Terminating (SIGTERM) 03:22:03.826598 --- ParallelTerminationStrategy: PID 19541 died... 03:22:03.845767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19541): Terminated: ok {rc=0} 03:22:03.890602 --- ParallelTerminationStrategy: PID 19544 died... 03:22:03.909286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19544): Terminated: ok {rc=0} 03:22:03.953774 --- ParallelTerminationStrategy: PID 19547 died... 03:22:03.972544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19547): Terminated: ok {rc=0} 03:22:04.059713 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 encryption register_a5_1_authreq.py ---------------------------------------------- 03:22:05.208462 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.219639 tst encryption: Using 1 x bts (candidates: 1) 03:22:05.253376 tst register_a5_1_authreq.py: using LAC 25639 03:22:05.374027 tst register_a5_1_authreq.py: using RAC 139 03:22:05.494442 tst register_a5_1_authreq.py: using CellId 25639 03:22:05.616632 tst register_a5_1_authreq.py: using BVCI 25640 03:22:05.737899 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.748803 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.760152 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.771668 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.783180 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.796087 tst encryption: Using 1 x modem (candidates: 1) 03:22:05.914096 tst register_a5_1_authreq.py:8: start network... 03:22:06.137830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:06.648049 run create_hlr_db(pid=19550): Launched 03:22:06.781956 bus /sierra_2: Setting Powered False 03:22:07.847418 run create_hlr_db(pid=19550): Terminated: ok {rc=0} 03:22:08.304669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Launched 03:22:08.632508 run osmo-hlr_10.42.42.2(pid=19553): Launched 03:22:08.757991 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:09.326546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19555): Launched 03:22:09.653995 run osmo-stp_10.42.42.5(pid=19556): Launched 03:22:09.779118 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:10.369973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19558): Launched 03:22:10.697610 run osmo-msc_10.42.42.6(pid=19559): Launched 03:22:10.881436 run osmo-stp_10.42.42.5(pid=19556): ERR: Terminated: ERROR {rc=1} [trial-2368↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19556)] 03:22:11.020645 run osmo-stp_10.42.42.5(pid=19556): stdout: | (launched: 2022-12-10_03:22:09.594845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:11.160885 run osmo-stp_10.42.42.5(pid=19556): stderr: | [0;m[38;5;43m20221210032209786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032209786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032209787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:11.299678 run osmo-stp_10.42.42.5(pid=19556): stdout: | (launched: 2022-12-10_03:22:09.594845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:11.430916 run osmo-stp_10.42.42.5(pid=19556): stderr: | [0;m[38;5;43m20221210032209786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032209786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032209787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:11.587573 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19556): Process ended prematurely: osmo-stp_10.42.42.5(pid=19556) [trial-2368↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19556)] [trial-2368↪encryption↪register_a5_1_authreq.py:8] 03:22:11.596854 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 03:22:11.624440 run osmo-hlr_10.42.42.2(pid=19553): ERR: Terminated: ERROR {rc=237} [trial-2368↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19553)] 03:22:11.674487 run osmo-hlr_10.42.42.2(pid=19553): stdout: | (launched: 2022-12-10_03:22:08.573031) 03:22:11.726270 run osmo-hlr_10.42.42.2(pid=19553): stderr: | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032208775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032208787 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032208797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:11.798627 run osmo-msc_10.42.42.6(pid=19559): ERR: Terminated: ERROR {rc=2} [trial-2368↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19559)] 03:22:11.848520 run osmo-msc_10.42.42.6(pid=19559): stdout: | (launched: 2022-12-10_03:22:10.638165) 03:22:11.900296 run osmo-msc_10.42.42.6(pid=19559): stderr: | [0;m[38;5;43m20221210032210961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032210961 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3487840c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032210961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032210961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032210961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032210961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032210963 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032210963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032210963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032210964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:11.952236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Terminating (SIGTERM) 03:22:11.993882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19555): Terminating (SIGTERM) 03:22:12.035698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19558): Terminating (SIGTERM) 03:22:12.077817 --- ParallelTerminationStrategy: PID 19552 died... 03:22:12.097886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19552): Terminated: ok {rc=0} 03:22:12.143967 --- ParallelTerminationStrategy: PID 19555 died... 03:22:12.163602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19555): Terminated: ok {rc=0} 03:22:12.209500 --- ParallelTerminationStrategy: PID 19558 died... 03:22:12.229060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19558): Terminated: ok {rc=0} 03:22:12.316594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2368 encryption register_a5_3_authreq.py ---------------------------------------------- 03:22:13.467866 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.479275 tst encryption: Using 1 x bts (candidates: 1) 03:22:13.517090 tst register_a5_3_authreq.py: using LAC 25640 03:22:13.647626 tst register_a5_3_authreq.py: using RAC 140 03:22:13.778656 tst register_a5_3_authreq.py: using CellId 25640 03:22:13.909079 tst register_a5_3_authreq.py: using BVCI 25641 03:22:14.030601 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:14.041552 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:14.052223 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:14.062958 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:14.073683 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:14.084251 tst encryption: Using 1 x modem (candidates: 1) 03:22:14.211921 tst register_a5_3_authreq.py:8: start network... 03:22:14.434163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:14.940095 run create_hlr_db(pid=19561): Launched 03:22:15.073394 bus /sierra_2: Setting Powered False 03:22:16.156300 run create_hlr_db(pid=19561): Terminated: ok {rc=0} 03:22:16.675203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19563): Launched 03:22:17.005806 run osmo-hlr_10.42.42.2(pid=19564): Launched 03:22:17.260144 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:17.801956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19566): Launched 03:22:18.108784 run osmo-stp_10.42.42.5(pid=19567): Launched 03:22:18.227724 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:18.779795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19569): Launched 03:22:19.085784 run osmo-msc_10.42.42.6(pid=19570): Launched 03:22:19.258377 run osmo-stp_10.42.42.5(pid=19567): ERR: Terminated: ERROR {rc=1} [trial-2368↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19567)] 03:22:19.389881 run osmo-stp_10.42.42.5(pid=19567): stdout: | (launched: 2022-12-10_03:22:18.053238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:19.520921 run osmo-stp_10.42.42.5(pid=19567): stderr: | [0;m[38;5;43m20221210032218221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032218221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032218222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032218222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032218224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032218225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032218225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:19.649517 run osmo-stp_10.42.42.5(pid=19567): stdout: | (launched: 2022-12-10_03:22:18.053238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:19.771897 run osmo-stp_10.42.42.5(pid=19567): stderr: | [0;m[38;5;43m20221210032218221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032218221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032218222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032218222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032218224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032218225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032218225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:19.918481 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19567): Process ended prematurely: osmo-stp_10.42.42.5(pid=19567) [trial-2368↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19567)] [trial-2368↪encryption↪register_a5_3_authreq.py:8] 03:22:19.927196 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 03:22:19.953358 run osmo-hlr_10.42.42.2(pid=19564): ERR: Terminated: ERROR {rc=237} [trial-2368↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19564)] 03:22:20.000933 run osmo-hlr_10.42.42.2(pid=19564): stdout: | (launched: 2022-12-10_03:22:16.935293) 03:22:20.050002 run osmo-hlr_10.42.42.2(pid=19564): stderr: | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032217158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032217188 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032217196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032217205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032217205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:20.118102 run osmo-msc_10.42.42.6(pid=19570): ERR: Terminated: ERROR {rc=2} [trial-2368↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19570)] 03:22:20.165302 run osmo-msc_10.42.42.6(pid=19570): stdout: | (launched: 2022-12-10_03:22:19.030177) 03:22:20.214293 run osmo-msc_10.42.42.6(pid=19570): stderr: | [0;m[38;5;43m20221210032219302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032219302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb26cd98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032219302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032219302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032219302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032219302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032219304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032219304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032219305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032219305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:20.263775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19563): Terminating (SIGTERM) 03:22:20.303170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19566): Terminating (SIGTERM) 03:22:20.342702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19569): Terminating (SIGTERM) 03:22:20.382312 --- ParallelTerminationStrategy: PID 19563 died... 03:22:20.401149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19563): Terminated: ok {rc=0} 03:22:20.444799 --- ParallelTerminationStrategy: PID 19566 died... 03:22:20.463129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19566): Terminated: ok {rc=0} 03:22:20.507358 --- ParallelTerminationStrategy: PID 19569 died... 03:22:20.525659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19569): Terminated: ok {rc=0} 03:22:20.611286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 03:22:21.818399 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:22:21.823387 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 03:22:21.842010 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 03:22:21.869229 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 03:22:21.899222 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 03:22:21.918012 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 03:22:21.946020 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 03:22:22.454781 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 03:22:22.459661 tst handover.py:11: TEST_CONFIG: {} 03:22:22.680412 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:22:22.696840 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:22:22.721050 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:22:22.772752 tst handover.py: using MSISDN 7530 03:22:22.894888 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7530', subscriber_id=0} 03:22:23.009078 run srsepc_10.42.42.118: Starting srsepc 03:22:24.925696 run rm-remote-dir(pid=19576): Launched 03:22:25.057165 bus /sierra_2: Setting Powered False 03:22:26.126206 run rm-remote-dir(pid=19576): Terminated: ok {rc=0} 03:22:26.596591 run mk-remote-dir(pid=19577): Launched 03:22:27.788082 run mk-remote-dir(pid=19577): Terminated: ok {rc=0} 03:22:28.093148 run scp-inst-to-remote(pid=19578): Launched 03:22:30.284745 run scp-inst-to-remote(pid=19578): Terminated: ok {rc=0} 03:22:30.639831 run rm-remote-dir(pid=19580): Launched 03:22:31.829369 run rm-remote-dir(pid=19580): Terminated: ok {rc=0} 03:22:32.177380 run mk-remote-dir(pid=19581): Launched 03:22:33.390597 run mk-remote-dir(pid=19581): Terminated: ok {rc=0} 03:22:33.695204 run scp-cfg-to-remote(pid=19582): Launched 03:22:34.884279 run scp-cfg-to-remote(pid=19582): Terminated: ok {rc=0} 03:22:35.186627 run scp-db-to-remote(pid=19584): Launched 03:22:36.376061 run scp-db-to-remote(pid=19584): Terminated: ok {rc=0} 03:22:36.516371 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:22:36.844477 run patchelf(pid=19586): Launched 03:22:38.029726 run patchelf(pid=19586): Terminated: ok {rc=0} 03:22:38.161150 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:22:38.471198 run setcap-netadm(pid=19587): Launched 03:22:39.649515 run setcap-netadm(pid=19587): Terminated: ok {rc=0} 03:22:39.971502 run srsepc(pid=19588): Launched 03:22:40.085237 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:22:41.189734 run rm-remote-dir(pid=19589): Launched 03:22:41.366971 run srsepc(pid=19588): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19588)] 03:22:41.501776 run srsepc(pid=19588): stdout: | (launched: 2022-12-10_03:22:39.915418) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:22:41.636891 run srsepc(pid=19588): stderr: | (launched: 2022-12-10_03:22:39.961183) | Connection to 10.42.42.116 closed. 03:22:41.771957 run srsepc(pid=19588): stdout: | (launched: 2022-12-10_03:22:39.915418) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:22:41.902042 run srsepc(pid=19588): stderr: | (launched: 2022-12-10_03:22:39.961183) | Connection to 10.42.42.116 closed. 03:22:42.055527 run rm-remote-dir(pid=19589): Terminating (SIGINT) 03:22:42.232741 run rm-remote-dir(pid=19589): Terminated: ok {rc=0} 03:22:42.361511 tst handover.py:37: ERR: Error: srsepc(pid=19588): Process ended prematurely: srsepc(pid=19588) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19588)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 03:22:42.371277 tst handover.py:37: Test FAILED (19.9 sec) 03:22:42.448793 run scp-back-log(pid=19590): Launched 03:22:43.526122 run scp-back-log(pid=19590): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19590)] 03:22:43.587182 run scp-back-log(pid=19590): stdout: | (launched: 2022-12-10_03:22:42.418523) 03:22:43.650241 run scp-back-log(pid=19590): stderr: | (launched: 2022-12-10_03:22:42.438361) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:22:43.721376 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19590): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19590)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 03:22:43.766506 tst iperf3_bidir.py:13: Number of physical ue: 1 03:22:43.972478 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:22:44.018712 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 03:22:44.222603 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:22:44.238307 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:22:44.269279 tst iperf3_bidir.py: using MSISDN 7531 03:22:44.380584 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7531', subscriber_id=0} 03:22:44.487681 run srsepc_10.42.42.118: Starting srsepc 03:22:45.114676 run rm-remote-dir(pid=19592): Launched 03:22:46.291330 run rm-remote-dir(pid=19592): Terminated: ok {rc=0} 03:22:46.640051 run mk-remote-dir(pid=19593): Launched 03:22:47.891506 run mk-remote-dir(pid=19593): Terminated: ok {rc=0} 03:22:48.176475 run scp-inst-to-remote(pid=19594): Launched 03:22:50.357562 run scp-inst-to-remote(pid=19594): Terminated: ok {rc=0} 03:22:50.712342 run rm-remote-dir(pid=19596): Launched 03:22:51.902947 run rm-remote-dir(pid=19596): Terminated: ok {rc=0} 03:22:52.258769 run mk-remote-dir(pid=19597): Launched 03:22:53.449595 run mk-remote-dir(pid=19597): Terminated: ok {rc=0} 03:22:53.753690 run scp-cfg-to-remote(pid=19598): Launched 03:22:54.942361 run scp-cfg-to-remote(pid=19598): Terminated: ok {rc=0} 03:22:55.243852 run scp-db-to-remote(pid=19600): Launched 03:22:56.436933 run scp-db-to-remote(pid=19600): Terminated: ok {rc=0} 03:22:56.576301 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:22:56.903742 run patchelf(pid=19602): Launched 03:22:58.092604 run patchelf(pid=19602): Terminated: ok {rc=0} 03:22:58.231709 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:22:58.559916 run setcap-netadm(pid=19603): Launched 03:22:59.748095 run setcap-netadm(pid=19603): Terminated: ok {rc=0} 03:23:00.090729 run srsepc(pid=19604): Launched 03:23:00.213545 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:01.439038 run rm-remote-dir(pid=19605): Launched 03:23:01.659160 run srsepc(pid=19604): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19604)] 03:23:01.810732 run srsepc(pid=19604): stdout: | (launched: 2022-12-10_03:23:00.031367) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:01.951604 run srsepc(pid=19604): stderr: | (launched: 2022-12-10_03:23:00.080185) | Connection to 10.42.42.116 closed. 03:23:02.091278 run srsepc(pid=19604): stdout: | (launched: 2022-12-10_03:23:00.031367) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:02.226720 run srsepc(pid=19604): stderr: | (launched: 2022-12-10_03:23:00.080185) | Connection to 10.42.42.116 closed. 03:23:02.383922 run rm-remote-dir(pid=19605): Terminating (SIGINT) 03:23:02.561531 run rm-remote-dir(pid=19605): Terminated: ok {rc=0} 03:23:02.689576 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=19604): Process ended prematurely: srsepc(pid=19604) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19604)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 03:23:02.699625 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 03:23:02.776890 run scp-back-log(pid=19606): Launched 03:23:03.853919 run scp-back-log(pid=19606): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19606)] 03:23:03.914716 run scp-back-log(pid=19606): stdout: | (launched: 2022-12-10_03:23:02.746717) 03:23:03.977198 run scp-back-log(pid=19606): stderr: | (launched: 2022-12-10_03:23:02.766520) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:04.047571 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19606): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19606)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 03:23:04.092887 tst iperf3_dl.py:13: Number of physical ue: 1 03:23:04.298650 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:04.355860 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 03:23:04.560289 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:04.575950 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:04.608648 tst iperf3_dl.py: using MSISDN 7532 03:23:04.719974 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7532', subscriber_id=0} 03:23:04.826701 run srsepc_10.42.42.118: Starting srsepc 03:23:05.449618 run rm-remote-dir(pid=19608): Launched 03:23:06.629566 run rm-remote-dir(pid=19608): Terminated: ok {rc=0} 03:23:06.962834 run mk-remote-dir(pid=19609): Launched 03:23:08.139993 run mk-remote-dir(pid=19609): Terminated: ok {rc=0} 03:23:08.424090 run scp-inst-to-remote(pid=19610): Launched 03:23:10.601915 run scp-inst-to-remote(pid=19610): Terminated: ok {rc=0} 03:23:10.933174 run rm-remote-dir(pid=19612): Launched 03:23:12.111412 run rm-remote-dir(pid=19612): Terminated: ok {rc=0} 03:23:12.444190 run mk-remote-dir(pid=19613): Launched 03:23:13.622607 run mk-remote-dir(pid=19613): Terminated: ok {rc=0} 03:23:13.906493 run scp-cfg-to-remote(pid=19614): Launched 03:23:15.086498 run scp-cfg-to-remote(pid=19614): Terminated: ok {rc=0} 03:23:15.387948 run scp-db-to-remote(pid=19617): Launched 03:23:16.611825 run scp-db-to-remote(pid=19617): Terminated: ok {rc=0} 03:23:16.810870 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:17.229637 run patchelf(pid=19679): Launched 03:23:18.581092 run patchelf(pid=19679): Terminated: ok {rc=0} 03:23:18.755227 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:19.088697 run setcap-netadm(pid=19898): Launched 03:23:20.291854 run setcap-netadm(pid=19898): Terminated: ok {rc=0} 03:23:20.649714 run srsepc(pid=19900): Launched 03:23:20.780452 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:21.938533 run rm-remote-dir(pid=19902): Launched 03:23:22.137893 run srsepc(pid=19900): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19900)] 03:23:22.325408 run srsepc(pid=19900): stdout: | (launched: 2022-12-10_03:23:20.586974) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:22.465488 run srsepc(pid=19900): stderr: | (launched: 2022-12-10_03:23:20.637560) | Connection to 10.42.42.116 closed. 03:23:22.603004 run srsepc(pid=19900): stdout: | (launched: 2022-12-10_03:23:20.586974) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:22.735510 run srsepc(pid=19900): stderr: | (launched: 2022-12-10_03:23:20.637560) | Connection to 10.42.42.116 closed. 03:23:22.892439 run rm-remote-dir(pid=19902): Terminating (SIGINT) 03:23:23.072355 run rm-remote-dir(pid=19902): Terminated: ok {rc=0} 03:23:23.203193 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=19900): Process ended prematurely: srsepc(pid=19900) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19900)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 03:23:23.214132 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 03:23:23.303863 run scp-back-log(pid=19903): Launched 03:23:24.420761 run scp-back-log(pid=19903): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19903)] 03:23:24.488630 run scp-back-log(pid=19903): stdout: | (launched: 2022-12-10_03:23:23.263846) 03:23:24.557439 run scp-back-log(pid=19903): stderr: | (launched: 2022-12-10_03:23:23.283702) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:24.634218 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19903): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19903)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 03:23:24.685275 tst iperf3_ul.py:13: Number of physical ue: 1 03:23:24.916010 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:24.961220 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 03:23:25.189427 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:25.207145 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:25.241746 tst iperf3_ul.py: using MSISDN 7533 03:23:25.365857 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7533', subscriber_id=0} 03:23:25.487339 run srsepc_10.42.42.118: Starting srsepc 03:23:26.186979 run rm-remote-dir(pid=19905): Launched 03:23:27.441917 run rm-remote-dir(pid=19905): Terminated: ok {rc=0} 03:23:27.816676 run mk-remote-dir(pid=19906): Launched 03:23:29.084341 run mk-remote-dir(pid=19906): Terminated: ok {rc=0} 03:23:29.401965 run scp-inst-to-remote(pid=19907): Launched 03:23:31.679476 run scp-inst-to-remote(pid=19907): Terminated: ok {rc=0} 03:23:32.108463 run rm-remote-dir(pid=19909): Launched 03:23:33.411155 run rm-remote-dir(pid=19909): Terminated: ok {rc=0} 03:23:33.764718 run mk-remote-dir(pid=19910): Launched 03:23:34.978164 run mk-remote-dir(pid=19910): Terminated: ok {rc=0} 03:23:35.296908 run scp-cfg-to-remote(pid=19911): Launched 03:23:36.553594 run scp-cfg-to-remote(pid=19911): Terminated: ok {rc=0} 03:23:36.872048 run scp-db-to-remote(pid=19913): Launched 03:23:38.126047 run scp-db-to-remote(pid=19913): Terminated: ok {rc=0} 03:23:38.273583 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:38.620308 run patchelf(pid=19915): Launched 03:23:39.869916 run patchelf(pid=19915): Terminated: ok {rc=0} 03:23:40.011990 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:40.345192 run setcap-netadm(pid=19917): Launched 03:23:41.537449 run setcap-netadm(pid=19917): Terminated: ok {rc=0} 03:23:41.886099 run srsepc(pid=19918): Launched 03:23:42.011774 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:43.207757 run rm-remote-dir(pid=19919): Launched 03:23:43.400029 run srsepc(pid=19918): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19918)] 03:23:43.545174 run srsepc(pid=19918): stdout: | (launched: 2022-12-10_03:23:41.826132) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:43.690325 run srsepc(pid=19918): stderr: | (launched: 2022-12-10_03:23:41.875322) | Connection to 10.42.42.116 closed. 03:23:43.835494 run srsepc(pid=19918): stdout: | (launched: 2022-12-10_03:23:41.826132) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:43.975493 run srsepc(pid=19918): stderr: | (launched: 2022-12-10_03:23:41.875322) | Connection to 10.42.42.116 closed. 03:23:44.141592 run rm-remote-dir(pid=19919): Terminating (SIGINT) 03:23:44.332085 run rm-remote-dir(pid=19919): Terminated: ok {rc=0} 03:23:44.469676 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=19918): Process ended prematurely: srsepc(pid=19918) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19918)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 03:23:44.480212 tst iperf3_ul.py:42: Test FAILED (19.8 sec) 03:23:44.561064 run scp-back-log(pid=19920): Launched 03:23:45.642752 run scp-back-log(pid=19920): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19920)] 03:23:45.706850 run scp-back-log(pid=19920): stdout: | (launched: 2022-12-10_03:23:44.529403) 03:23:45.772929 run scp-back-log(pid=19920): stderr: | (launched: 2022-12-10_03:23:44.550317) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:45.849497 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19920): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19920)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 03:23:45.905377 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:45.923184 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:45.947715 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:46.004296 tst ping.py: using MSISDN 7534 03:23:46.152804 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7534', subscriber_id=0} 03:23:46.269213 run srsepc_10.42.42.118: Starting srsepc 03:23:46.933787 run rm-remote-dir(pid=19922): Launched 03:23:48.119085 run rm-remote-dir(pid=19922): Terminated: ok {rc=0} 03:23:48.458181 run mk-remote-dir(pid=19923): Launched 03:23:49.638903 run mk-remote-dir(pid=19923): Terminated: ok {rc=0} 03:23:49.927654 run scp-inst-to-remote(pid=19924): Launched 03:23:52.109818 run scp-inst-to-remote(pid=19924): Terminated: ok {rc=0} 03:23:52.446909 run rm-remote-dir(pid=19926): Launched 03:23:53.628399 run rm-remote-dir(pid=19926): Terminated: ok {rc=0} 03:23:53.967337 run mk-remote-dir(pid=19927): Launched 03:23:55.147677 run mk-remote-dir(pid=19927): Terminated: ok {rc=0} 03:23:55.435898 run scp-cfg-to-remote(pid=19928): Launched 03:23:56.615143 run scp-cfg-to-remote(pid=19928): Terminated: ok {rc=0} 03:23:56.902034 run scp-db-to-remote(pid=19930): Launched 03:23:58.080146 run scp-db-to-remote(pid=19930): Terminated: ok {rc=0} 03:23:58.212514 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:58.523571 run patchelf(pid=19932): Launched 03:23:59.699655 run patchelf(pid=19932): Terminated: ok {rc=0} 03:23:59.831788 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:00.143530 run setcap-netadm(pid=19933): Launched 03:24:01.321842 run setcap-netadm(pid=19933): Terminated: ok {rc=0} 03:24:01.659426 run srsepc(pid=19934): Launched 03:24:01.890322 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:03.146324 run rm-remote-dir(pid=19935): Launched 03:24:03.340408 run srsepc(pid=19934): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19934)] 03:24:03.486697 run srsepc(pid=19934): stdout: | (launched: 2022-12-10_03:24:01.598656) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:03.632229 run srsepc(pid=19934): stderr: | (launched: 2022-12-10_03:24:01.645726) | Connection to 10.42.42.116 closed. 03:24:03.777744 run srsepc(pid=19934): stdout: | (launched: 2022-12-10_03:24:01.598656) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:03.917986 run srsepc(pid=19934): stderr: | (launched: 2022-12-10_03:24:01.645726) | Connection to 10.42.42.116 closed. 03:24:04.085045 run rm-remote-dir(pid=19935): Terminating (SIGINT) 03:24:04.275722 run rm-remote-dir(pid=19935): Terminated: ok {rc=0} 03:24:04.414070 tst ping.py:16: ERR: Error: srsepc(pid=19934): Process ended prematurely: srsepc(pid=19934) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19934)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 03:24:04.424745 tst ping.py:16: Test FAILED (18.5 sec) 03:24:04.505547 run scp-back-log(pid=19936): Launched 03:24:05.586380 run scp-back-log(pid=19936): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19936)] 03:24:05.648625 run scp-back-log(pid=19936): stdout: | (launched: 2022-12-10_03:24:04.474131) 03:24:05.711630 run scp-back-log(pid=19936): stderr: | (launched: 2022-12-10_03:24:04.494860) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:05.782209 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19936): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19936)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 03:24:05.828836 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:05.845696 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:05.869521 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:05.922342 tst rrc_idle_mo_ping.py: using MSISDN 7535 03:24:06.039028 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7535', subscriber_id=0} 03:24:06.147202 run srsepc_10.42.42.118: Starting srsepc 03:24:06.778441 run rm-remote-dir(pid=19938): Launched 03:24:07.960284 run rm-remote-dir(pid=19938): Terminated: ok {rc=0} 03:24:08.299220 run mk-remote-dir(pid=19939): Launched 03:24:09.478676 run mk-remote-dir(pid=19939): Terminated: ok {rc=0} 03:24:09.766609 run scp-inst-to-remote(pid=19940): Launched 03:24:11.949988 run scp-inst-to-remote(pid=19940): Terminated: ok {rc=0} 03:24:12.308276 run rm-remote-dir(pid=19942): Launched 03:24:13.501462 run rm-remote-dir(pid=19942): Terminated: ok {rc=0} 03:24:13.861259 run mk-remote-dir(pid=19943): Launched 03:24:15.053980 run mk-remote-dir(pid=19943): Terminated: ok {rc=0} 03:24:15.361061 run scp-cfg-to-remote(pid=19944): Launched 03:24:16.549906 run scp-cfg-to-remote(pid=19944): Terminated: ok {rc=0} 03:24:16.860752 run scp-db-to-remote(pid=19946): Launched 03:24:18.087309 run scp-db-to-remote(pid=19946): Terminated: ok {rc=0} 03:24:18.219618 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:18.530778 run patchelf(pid=19948): Launched 03:24:19.709148 run patchelf(pid=19948): Terminated: ok {rc=0} 03:24:19.842064 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:20.153437 run setcap-netadm(pid=19949): Launched 03:24:21.331203 run setcap-netadm(pid=19949): Terminated: ok {rc=0} 03:24:21.657430 run srsepc(pid=19950): Launched 03:24:21.774722 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:22.891676 run rm-remote-dir(pid=19951): Launched 03:24:23.069233 run srsepc(pid=19950): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19950)] 03:24:23.204519 run srsepc(pid=19950): stdout: | (launched: 2022-12-10_03:24:21.600828) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:23.340877 run srsepc(pid=19950): stderr: | (launched: 2022-12-10_03:24:21.646807) | Connection to 10.42.42.116 closed. 03:24:23.477326 run srsepc(pid=19950): stdout: | (launched: 2022-12-10_03:24:21.600828) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:23.608252 run srsepc(pid=19950): stderr: | (launched: 2022-12-10_03:24:21.646807) | Connection to 10.42.42.116 closed. 03:24:23.763336 run rm-remote-dir(pid=19951): Terminating (SIGINT) 03:24:23.942299 run rm-remote-dir(pid=19951): Terminated: ok {rc=0} 03:24:24.072437 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=19950): Process ended prematurely: srsepc(pid=19950) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19950)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 03:24:24.082705 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 03:24:24.161315 run scp-back-log(pid=19952): Launched 03:24:25.238782 run scp-back-log(pid=19952): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19952)] 03:24:25.300348 run scp-back-log(pid=19952): stdout: | (launched: 2022-12-10_03:24:24.130819) 03:24:25.363061 run scp-back-log(pid=19952): stderr: | (launched: 2022-12-10_03:24:24.150867) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:25.434092 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19952): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19952)]') ---------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 03:24:25.481344 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:25.497968 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:25.521553 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:25.570028 tst rrc_idle_mt_ping.py: using MSISDN 7536 03:24:25.685387 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7536', subscriber_id=0} 03:24:25.793462 run srsepc_10.42.42.118: Starting srsepc 03:24:26.426151 run rm-remote-dir(pid=19954): Launched 03:24:27.608186 run rm-remote-dir(pid=19954): Terminated: ok {rc=0} 03:24:27.946020 run mk-remote-dir(pid=19955): Launched 03:24:29.126488 run mk-remote-dir(pid=19955): Terminated: ok {rc=0} 03:24:29.413963 run scp-inst-to-remote(pid=19956): Launched 03:24:31.607033 run scp-inst-to-remote(pid=19956): Terminated: ok {rc=0} 03:24:32.020916 run rm-remote-dir(pid=19958): Launched 03:24:33.264907 run rm-remote-dir(pid=19958): Terminated: ok {rc=0} 03:24:33.603074 run mk-remote-dir(pid=19961): Launched 03:24:34.783306 run mk-remote-dir(pid=19961): Terminated: ok {rc=0} 03:24:35.071154 run scp-cfg-to-remote(pid=19962): Launched 03:24:36.251672 run scp-cfg-to-remote(pid=19962): Terminated: ok {rc=0} 03:24:36.537606 run scp-db-to-remote(pid=19964): Launched 03:24:37.716267 run scp-db-to-remote(pid=19964): Terminated: ok {rc=0} 03:24:37.848187 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:38.158580 run patchelf(pid=19966): Launched 03:24:39.338945 run patchelf(pid=19966): Terminated: ok {rc=0} 03:24:39.471189 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:39.781383 run setcap-netadm(pid=19967): Launched 03:24:40.959782 run setcap-netadm(pid=19967): Terminated: ok {rc=0} 03:24:41.286014 run srsepc(pid=19968): Launched 03:24:41.401150 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:42.522932 run rm-remote-dir(pid=19969): Launched 03:24:42.699726 run srsepc(pid=19968): ERR: Terminated: ERROR {rc=127} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19968)] 03:24:42.835191 run srsepc(pid=19968): stdout: | (launched: 2022-12-10_03:24:41.229174) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:42.971204 run srsepc(pid=19968): stderr: | (launched: 2022-12-10_03:24:41.275383) | Connection to 10.42.42.116 closed. 03:24:43.107314 run srsepc(pid=19968): stdout: | (launched: 2022-12-10_03:24:41.229174) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:43.238250 run srsepc(pid=19968): stderr: | (launched: 2022-12-10_03:24:41.275383) | Connection to 10.42.42.116 closed. 03:24:43.392825 run rm-remote-dir(pid=19969): Terminating (SIGINT) 03:24:43.571533 run rm-remote-dir(pid=19969): Terminated: ok {rc=0} 03:24:43.701080 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=19968): Process ended prematurely: srsepc(pid=19968) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19968)] [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 03:24:43.710910 tst rrc_idle_mt_ping.py:16: Test FAILED (18.2 sec) 03:24:43.789158 run scp-back-log(pid=19970): Launched 03:24:44.866998 run scp-back-log(pid=19970): ERR: Terminated: ERROR {rc=1} [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19970)] 03:24:44.928305 run scp-back-log(pid=19970): stdout: | (launched: 2022-12-10_03:24:43.757947) 03:24:44.991263 run scp-back-log(pid=19970): stderr: | (launched: 2022-12-10_03:24:43.777745) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:45.061543 tst srsepc_10.42.42.118: Error('scp-back-log(pid=19970): launch_sync(): local process exited with status 1 [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=19970)]') --------------------------------------------------------------------- trial-2368 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 03:24:45.190672 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:24:45.195689 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 03:24:45.236924 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 03:24:45.263489 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 03:24:45.315106 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 03:24:45.357637 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 03:24:45.383921 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 03:24:45.952707 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 03:24:45.958822 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:45.970458 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:24:46.012567 tst handover.py: using LAC 25641 03:24:46.145344 tst handover.py: using RAC 141 03:24:46.299324 tst handover.py: using CellId 25641 03:24:46.428665 tst handover.py: using BVCI 25642 03:24:46.553279 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:24:46.588362 tst handover.py: using LAC 25642 03:24:46.718301 tst handover.py: using RAC 142 03:24:46.872161 tst handover.py: using CellId 25642 03:24:47.001100 tst handover.py: using BVCI 25643 03:24:47.123668 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:47.135459 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:47.147059 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:47.158816 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:47.170607 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:47.182066 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:24:47.306472 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:24:47.424118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:24:47.896408 run create_hlr_db(pid=19975): Launched 03:24:49.076356 run create_hlr_db(pid=19975): Terminated: ok {rc=0} 03:24:49.400392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Launched 03:24:49.706319 run osmo-hlr_10.42.42.2(pid=19978): Launched 03:24:49.823149 run osmo-stp_10.42.42.5: Starting osmo-stp 03:24:50.346548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Launched 03:24:50.653802 run osmo-stp_10.42.42.5(pid=19981): Launched 03:24:50.771680 run osmo-msc_10.42.42.6: Starting osmo-msc 03:24:51.325963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19983): Launched 03:24:51.631836 run osmo-msc_10.42.42.6(pid=19984): Launched 03:24:51.803363 run osmo-stp_10.42.42.5(pid=19981): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] 03:24:51.933753 run osmo-stp_10.42.42.5(pid=19981): stdout: | (launched: 2022-12-10_03:24:50.597865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:24:52.064038 run osmo-stp_10.42.42.5(pid=19981): stderr: | [0;m[38;5;43m20221210032450766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032450766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032450767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032450767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032450769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032450770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032450770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:24:52.192148 run osmo-stp_10.42.42.5(pid=19981): stdout: | (launched: 2022-12-10_03:24:50.597865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:24:52.313841 run osmo-stp_10.42.42.5(pid=19981): stderr: | [0;m[38;5;43m20221210032450766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032450766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032450767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032450767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032450769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032450770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032450770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:24:52.459986 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19981): Process ended prematurely: osmo-stp_10.42.42.5(pid=19981) [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 03:24:52.468515 tst handover.py:18: Test FAILED (6.5 sec) 03:24:52.494865 run osmo-hlr_10.42.42.2(pid=19978): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19978)] 03:24:52.542586 run osmo-hlr_10.42.42.2(pid=19978): stdout: | (launched: 2022-12-10_03:24:49.650438) 03:24:52.592323 run osmo-hlr_10.42.42.2(pid=19978): stderr: | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032449826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032449838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032449848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032449848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032449848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:24:52.661184 run osmo-msc_10.42.42.6(pid=19984): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19984)] 03:24:52.709097 run osmo-msc_10.42.42.6(pid=19984): stdout: | (launched: 2022-12-10_03:24:51.576282) 03:24:52.758460 run osmo-msc_10.42.42.6(pid=19984): stderr: | [0;m[38;5;43m20221210032451849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032451849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff890766c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032451849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032451849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032451849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032451850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032451851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032451852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032451852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032451852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:24:52.808397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Terminating (SIGTERM) 03:24:52.848282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Terminating (SIGTERM) 03:24:52.888274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19983): Terminating (SIGTERM) 03:24:52.928546 --- ParallelTerminationStrategy: PID 19977 died... 03:24:52.947672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Terminated: ok {rc=0} 03:24:52.992169 --- ParallelTerminationStrategy: PID 19980 died... 03:24:53.010829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Terminated: ok {rc=0} 03:24:53.055053 --- ParallelTerminationStrategy: PID 19983 died... 03:24:53.073744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19983): Terminated: ok {rc=0} 03:24:53.160152 bus /sierra_3: Setting Powered False 03:24:54.261691 bus /sierra_3: Setting Powered False 03:24:55.377986 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 03:24:56.626848 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:24:56.632190 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:24:56.673140 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:24:56.700524 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:24:56.754510 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:24:56.795375 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:24:56.822467 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:24:57.373795 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 03:24:57.379994 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:57.391456 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:24:57.432520 tst handover.py: using LAC 25643 03:24:57.557064 tst handover.py: using RAC 143 03:24:57.686372 tst handover.py: using CellId 25643 03:24:57.815725 tst handover.py: using BVCI 25644 03:24:57.935131 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:24:57.969667 tst handover.py: using LAC 25644 03:24:58.092119 tst handover.py: using RAC 144 03:24:58.212236 tst handover.py: using CellId 25644 03:24:58.332116 tst handover.py: using BVCI 25645 03:24:58.444746 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:58.455771 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:58.466670 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:58.478286 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:58.489784 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:24:58.501260 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:24:58.622083 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:24:58.742951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:24:59.219881 run create_hlr_db(pid=19989): Launched 03:24:59.353361 bus /sierra_2: Setting Powered False 03:25:00.418533 run create_hlr_db(pid=19989): Terminated: ok {rc=0} 03:25:00.849597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19991): Launched 03:25:01.209693 run osmo-hlr_10.42.42.2(pid=19992): Launched 03:25:01.460674 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:02.113729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Launched 03:25:02.466119 run osmo-stp_10.42.42.5(pid=19999): Launched 03:25:02.703210 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:03.347546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20007): Launched 03:25:03.676335 run osmo-msc_10.42.42.6(pid=20008): Launched 03:25:03.858679 run osmo-stp_10.42.42.5(pid=19999): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19999)] 03:25:03.996475 run osmo-stp_10.42.42.5(pid=19999): stdout: | (launched: 2022-12-10_03:25:02.399248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:04.134891 run osmo-stp_10.42.42.5(pid=19999): stderr: | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032502771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:04.272318 run osmo-stp_10.42.42.5(pid=19999): stdout: | (launched: 2022-12-10_03:25:02.399248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:04.403074 run osmo-stp_10.42.42.5(pid=19999): stderr: | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032502770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032502771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032502771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:04.559353 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19999): Process ended prematurely: osmo-stp_10.42.42.5(pid=19999) [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19999)] [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 03:25:04.568256 tst handover.py:18: Test FAILED (7.2 sec) 03:25:04.595509 run osmo-hlr_10.42.42.2(pid=19992): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19992)] 03:25:04.645629 run osmo-hlr_10.42.42.2(pid=19992): stdout: | (launched: 2022-12-10_03:25:01.140872) 03:25:04.697349 run osmo-hlr_10.42.42.2(pid=19992): stderr: | [0;m[1;31m20221210032501352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032501352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032501352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032501352 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032501353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032501353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032501369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032501388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032501392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032501392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:04.769467 run osmo-msc_10.42.42.6(pid=20008): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20008)] 03:25:04.819521 run osmo-msc_10.42.42.6(pid=20008): stdout: | (launched: 2022-12-10_03:25:03.616387) 03:25:04.871084 run osmo-msc_10.42.42.6(pid=20008): stderr: | [0;m[38;5;43m20221210032503940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032503940 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f38a8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032503940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032503940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032503940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032503940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032503942 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032503942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032503943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032503943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:04.922925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19991): Terminating (SIGTERM) 03:25:04.964435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Terminating (SIGTERM) 03:25:05.006218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20007): Terminating (SIGTERM) 03:25:05.048332 --- ParallelTerminationStrategy: PID 19991 died... 03:25:05.068381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19991): Terminated: ok {rc=0} 03:25:05.115184 --- ParallelTerminationStrategy: PID 19998 died... 03:25:05.134814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19998): Terminated: ok {rc=0} 03:25:05.180556 --- ParallelTerminationStrategy: PID 20007 died... 03:25:05.200034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20007): Terminated: ok {rc=0} 03:25:05.287910 bus /sierra_3: Setting Powered False 03:25:06.389254 bus /sierra_3: Setting Powered False 03:25:07.501559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 03:25:08.743097 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:08.748006 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:25:08.801179 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:25:08.827506 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:25:08.880005 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:25:08.932464 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:25:08.958668 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:25:09.513572 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 03:25:09.518623 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:09.529436 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:09.566981 tst handover.py: using LAC 25645 03:25:09.687332 tst handover.py: using RAC 145 03:25:09.806446 tst handover.py: using CellId 25645 03:25:09.926272 tst handover.py: using BVCI 25646 03:25:10.037607 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:10.083943 tst handover.py: using LAC 25646 03:25:10.202343 tst handover.py: using RAC 146 03:25:10.325365 tst handover.py: using CellId 25646 03:25:10.445993 tst handover.py: using BVCI 25647 03:25:10.559411 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:10.570266 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:10.580906 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:10.592018 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:10.603059 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:10.613893 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:10.733971 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:10.850413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:11.329367 run create_hlr_db(pid=20014): Launched 03:25:11.463465 bus /sierra_2: Setting Powered False 03:25:12.528309 run create_hlr_db(pid=20014): Terminated: ok {rc=0} 03:25:12.965691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Launched 03:25:13.333730 run osmo-hlr_10.42.42.2(pid=20047): Launched 03:25:13.530045 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:14.123388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20169): Launched 03:25:14.465757 run osmo-stp_10.42.42.5(pid=20213): Launched 03:25:14.702340 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:15.334741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20373): Launched 03:25:15.662182 run osmo-msc_10.42.42.6(pid=20374): Launched 03:25:15.844201 run osmo-stp_10.42.42.5(pid=20213): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] 03:25:16.066299 run osmo-stp_10.42.42.5(pid=20213): stdout: | (launched: 2022-12-10_03:25:14.399576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:16.251969 run osmo-stp_10.42.42.5(pid=20213): stderr: | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032514747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:16.618166 run osmo-stp_10.42.42.5(pid=20213): stdout: | (launched: 2022-12-10_03:25:14.399576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:16.796850 run osmo-stp_10.42.42.5(pid=20213): stderr: | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032514746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032514747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032514747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:16.954687 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20213): Process ended prematurely: osmo-stp_10.42.42.5(pid=20213) [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 03:25:16.963865 tst handover.py:18: Test FAILED (7.4 sec) 03:25:16.992397 run osmo-hlr_10.42.42.2(pid=20047): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20047)] 03:25:17.042274 run osmo-hlr_10.42.42.2(pid=20047): stdout: | (launched: 2022-12-10_03:25:13.263830) 03:25:17.095215 run osmo-hlr_10.42.42.2(pid=20047): stderr: | [0;m[1;31m20221210032513608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032513608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032513608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032513609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032513609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032513609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032513641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032513654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032513654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032513654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:17.167438 run osmo-msc_10.42.42.6(pid=20374): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20374)] 03:25:17.217469 run osmo-msc_10.42.42.6(pid=20374): stdout: | (launched: 2022-12-10_03:25:15.602692) 03:25:17.270922 run osmo-msc_10.42.42.6(pid=20374): stderr: | [0;m[38;5;43m20221210032516063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032516063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d5ed92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032516063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032516064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032516064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032516064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032516073 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032516073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032516073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032516073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:17.323343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Terminating (SIGTERM) 03:25:17.365804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20169): Terminating (SIGTERM) 03:25:17.407781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20373): Terminating (SIGTERM) 03:25:17.448143 --- ParallelTerminationStrategy: PID 20018 died... 03:25:17.467213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20018): Terminated: ok {rc=0} 03:25:17.511620 --- ParallelTerminationStrategy: PID 20169 died... 03:25:17.530314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20169): Terminated: ok {rc=0} 03:25:17.575749 --- ParallelTerminationStrategy: PID 20373 died... 03:25:17.594437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20373): Terminated: ok {rc=0} 03:25:17.679568 bus /sierra_3: Setting Powered False 03:25:18.780586 bus /sierra_3: Setting Powered False 03:25:19.897643 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:25:21.159003 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:21.165105 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:25:21.215281 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:25:21.241636 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:25:21.293801 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:25:21.344748 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:25:21.372738 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:25:21.927067 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:25:21.932765 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:21.944426 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:21.983844 tst handover.py: using LAC 25647 03:25:22.110560 tst handover.py: using RAC 147 03:25:22.240519 tst handover.py: using CellId 25647 03:25:22.368267 tst handover.py: using BVCI 25648 03:25:22.486694 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:22.535752 tst handover.py: using LAC 25648 03:25:22.663659 tst handover.py: using RAC 148 03:25:22.789460 tst handover.py: using CellId 25648 03:25:22.910744 tst handover.py: using BVCI 25649 03:25:23.022302 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:23.033483 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:23.044512 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:23.056382 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:23.068137 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:23.079904 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:23.200421 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:23.322182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:23.812864 run create_hlr_db(pid=20461): Launched 03:25:23.976110 bus /sierra_2: Setting Powered False 03:25:25.037873 run create_hlr_db(pid=20461): Terminated: ok {rc=0} 03:25:25.451516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Launched 03:25:25.783983 run osmo-hlr_10.42.42.2(pid=20558): Launched 03:25:26.027242 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:26.734362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Launched 03:25:27.060064 run osmo-stp_10.42.42.5(pid=20561): Launched 03:25:27.305414 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:28.007480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Launched 03:25:28.342277 run osmo-msc_10.42.42.6(pid=20564): Launched 03:25:28.729794 run osmo-stp_10.42.42.5(pid=20561): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] 03:25:29.049196 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-10_03:25:27.002417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:29.188032 run osmo-stp_10.42.42.5(pid=20561): stderr: | [0;m[38;5;43m20221210032527327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032527328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032527328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032527328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:29.337484 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-10_03:25:27.002417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:29.468475 run osmo-stp_10.42.42.5(pid=20561): stderr: | [0;m[38;5;43m20221210032527327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032527328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032527328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032527328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032527333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:29.624772 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 03:25:29.633661 tst handover.py:18: Test FAILED (7.7 sec) 03:25:29.661370 run osmo-hlr_10.42.42.2(pid=20558): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20558)] 03:25:29.711616 run osmo-hlr_10.42.42.2(pid=20558): stdout: | (launched: 2022-12-10_03:25:25.722232) 03:25:29.763757 run osmo-hlr_10.42.42.2(pid=20558): stderr: | [0;m[1;31m20221210032526081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032526082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032526082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032526082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032526082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032526082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032526124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032526132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032526140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032526140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:29.836330 run osmo-msc_10.42.42.6(pid=20564): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20564)] 03:25:29.886637 run osmo-msc_10.42.42.6(pid=20564): stdout: | (launched: 2022-12-10_03:25:28.276892) 03:25:29.938541 run osmo-msc_10.42.42.6(pid=20564): stderr: | [0;m[38;5;43m20221210032528953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032528953 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f18276b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032528954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032528954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032528954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032528954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032528961 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032528961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032528961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032528961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:29.990699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminating (SIGTERM) 03:25:30.032462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminating (SIGTERM) 03:25:30.074510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Terminating (SIGTERM) 03:25:30.116614 --- ParallelTerminationStrategy: PID 20557 died... 03:25:30.136662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminated: ok {rc=0} 03:25:30.183370 --- ParallelTerminationStrategy: PID 20560 died... 03:25:30.203235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminated: ok {rc=0} 03:25:30.249399 --- ParallelTerminationStrategy: PID 20563 died... 03:25:30.269171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20563): Terminated: ok {rc=0} 03:25:30.358660 bus /sierra_3: Setting Powered False 03:25:31.459741 bus /sierra_3: Setting Powered False 03:25:32.580266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:25:33.841556 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:33.847284 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:25:33.904070 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:25:33.931299 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:25:33.986432 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:25:34.042771 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:25:34.070511 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:25:34.622462 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:25:34.628115 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:34.639751 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:25:34.680634 tst handover.py: using LAC 25649 03:25:34.809713 tst handover.py: using RAC 149 03:25:34.938273 tst handover.py: using CellId 25649 03:25:35.067859 tst handover.py: using BVCI 25650 03:25:35.188192 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:25:35.243064 tst handover.py: using LAC 25650 03:25:35.370688 tst handover.py: using RAC 150 03:25:35.497507 tst handover.py: using CellId 25650 03:25:35.626028 tst handover.py: using BVCI 25651 03:25:35.746383 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:35.757978 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:35.769254 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:35.780717 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:35.792353 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:35.803903 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:25:35.919094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:25:36.035890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:36.482968 run create_hlr_db(pid=20571): Launched 03:25:36.600875 bus /sierra_2: Setting Powered False 03:25:37.665248 run create_hlr_db(pid=20571): Terminated: ok {rc=0} 03:25:38.077620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Launched 03:25:38.385611 run osmo-hlr_10.42.42.2(pid=20574): Launched 03:25:38.503600 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:39.014289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Launched 03:25:39.321196 run osmo-stp_10.42.42.5(pid=20577): Launched 03:25:39.439812 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:39.971281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Launched 03:25:40.298429 run osmo-msc_10.42.42.6(pid=20580): Launched 03:25:40.482144 run osmo-stp_10.42.42.5(pid=20577): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] 03:25:40.621297 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-10_03:25:39.264902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:40.760430 run osmo-stp_10.42.42.5(pid=20577): stderr: | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032539440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:40.898224 run osmo-stp_10.42.42.5(pid=20577): stdout: | (launched: 2022-12-10_03:25:39.264902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:41.028852 run osmo-stp_10.42.42.5(pid=20577): stderr: | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032539439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032539440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032539440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:41.184530 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 03:25:41.193647 tst handover.py:18: Test FAILED (6.6 sec) 03:25:41.221592 run osmo-hlr_10.42.42.2(pid=20574): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20574)] 03:25:41.272129 run osmo-hlr_10.42.42.2(pid=20574): stdout: | (launched: 2022-12-10_03:25:38.329304) 03:25:41.324543 run osmo-hlr_10.42.42.2(pid=20574): stderr: | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032538508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032538519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032538527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032538527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032538527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:41.397951 run osmo-msc_10.42.42.6(pid=20580): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20580)] 03:25:41.448543 run osmo-msc_10.42.42.6(pid=20580): stdout: | (launched: 2022-12-10_03:25:40.239460) 03:25:41.500248 run osmo-msc_10.42.42.6(pid=20580): stderr: | [0;m[38;5;43m20221210032540562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032540562 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb87e8bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032540562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032540562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032540562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032540562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032540564 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032540564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032540565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032540565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:41.552695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminating (SIGTERM) 03:25:41.594922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminating (SIGTERM) 03:25:41.637780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminating (SIGTERM) 03:25:41.680649 --- ParallelTerminationStrategy: PID 20573 died... 03:25:41.700861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20573): Terminated: ok {rc=0} 03:25:41.747808 --- ParallelTerminationStrategy: PID 20576 died... 03:25:41.767479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20576): Terminated: ok {rc=0} 03:25:41.814307 --- ParallelTerminationStrategy: PID 20579 died... 03:25:41.834065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20579): Terminated: ok {rc=0} 03:25:41.945781 bus /sierra_3: Setting Powered False 03:25:43.045126 bus /sierra_3: Setting Powered False 03:25:44.161122 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 03:25:45.422602 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:45.428515 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:25:45.474043 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:25:45.500740 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:25:45.553403 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:25:45.595434 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:25:45.622419 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:25:46.193761 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 03:25:46.201311 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:46.215519 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:25:46.266681 tst handover.py: using LAC 25651 03:25:46.416842 tst handover.py: using RAC 151 03:25:46.539125 tst handover.py: using CellId 25651 03:25:46.672120 tst handover.py: using BVCI 25652 03:25:46.809969 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:25:46.846679 tst handover.py: using LAC 25652 03:25:46.986827 tst handover.py: using RAC 152 03:25:47.143739 tst handover.py: using CellId 25652 03:25:47.278072 tst handover.py: using BVCI 25653 03:25:47.390403 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:47.401378 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:47.412155 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:47.423338 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:47.434565 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:47.445600 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:25:47.566677 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:25:47.686511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:48.163936 run create_hlr_db(pid=20585): Launched 03:25:48.296000 bus /sierra_2: Setting Powered False 03:25:49.360030 run create_hlr_db(pid=20585): Terminated: ok {rc=0} 03:25:49.772125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20587): Launched 03:25:50.098427 run osmo-hlr_10.42.42.2(pid=20588): Launched 03:25:50.223431 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:50.755938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20590): Launched 03:25:51.082466 run osmo-stp_10.42.42.5(pid=20591): Launched 03:25:51.207199 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:51.768799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20593): Launched 03:25:52.095228 run osmo-msc_10.42.42.6(pid=20594): Launched 03:25:52.279384 run osmo-stp_10.42.42.5(pid=20591): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20591)] 03:25:52.417762 run osmo-stp_10.42.42.5(pid=20591): stdout: | (launched: 2022-12-10_03:25:51.023324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:52.556137 run osmo-stp_10.42.42.5(pid=20591): stderr: | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032551215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:52.693675 run osmo-stp_10.42.42.5(pid=20591): stdout: | (launched: 2022-12-10_03:25:51.023324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:52.823464 run osmo-stp_10.42.42.5(pid=20591): stderr: | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032551215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032551215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032551216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:52.979277 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20591): Process ended prematurely: osmo-stp_10.42.42.5(pid=20591) [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20591)] [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 03:25:52.988005 tst handover.py:18: Test FAILED (6.8 sec) 03:25:53.015151 run osmo-hlr_10.42.42.2(pid=20588): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20588)] 03:25:53.064622 run osmo-hlr_10.42.42.2(pid=20588): stdout: | (launched: 2022-12-10_03:25:50.039078) 03:25:53.116310 run osmo-hlr_10.42.42.2(pid=20588): stderr: | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032550236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032550259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032550269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032550269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032550269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:53.187938 run osmo-msc_10.42.42.6(pid=20594): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20594)] 03:25:53.237680 run osmo-msc_10.42.42.6(pid=20594): stdout: | (launched: 2022-12-10_03:25:52.035955) 03:25:53.288939 run osmo-msc_10.42.42.6(pid=20594): stderr: | [0;m[38;5;43m20221210032552360 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032552360 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f255c5a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032552360 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032552360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032552360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032552361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032552362 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032552363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032552363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032552363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:53.340766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20587): Terminating (SIGTERM) 03:25:53.382556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20590): Terminating (SIGTERM) 03:25:53.424114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20593): Terminating (SIGTERM) 03:25:53.466064 --- ParallelTerminationStrategy: PID 20587 died... 03:25:53.486141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20587): Terminated: ok {rc=0} 03:25:53.532299 --- ParallelTerminationStrategy: PID 20590 died... 03:25:53.551945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20590): Terminated: ok {rc=0} 03:25:53.597931 --- ParallelTerminationStrategy: PID 20593 died... 03:25:53.617652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20593): Terminated: ok {rc=0} 03:25:53.705968 bus /sierra_3: Setting Powered False 03:25:54.804229 bus /sierra_3: Setting Powered False 03:25:55.921433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 03:25:57.187668 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:57.193193 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:25:57.248119 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:25:57.275425 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:25:57.327719 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:25:57.381099 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:25:57.407348 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:25:57.963049 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 03:25:57.968422 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:57.979697 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:25:58.023468 tst handover.py: using LAC 25653 03:25:58.152661 tst handover.py: using RAC 153 03:25:58.281721 tst handover.py: using CellId 25653 03:25:58.404464 tst handover.py: using BVCI 25654 03:25:58.523938 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:25:58.572865 tst handover.py: using LAC 25654 03:25:58.700445 tst handover.py: using RAC 154 03:25:58.831331 tst handover.py: using CellId 25654 03:25:58.958331 tst handover.py: using BVCI 25655 03:25:59.076793 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:59.088205 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:59.099532 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:59.110726 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:59.122009 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:25:59.133095 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:25:59.248833 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:25:59.366547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:59.814185 run create_hlr_db(pid=20599): Launched 03:25:59.932060 bus /sierra_2: Setting Powered False 03:26:01.001608 run create_hlr_db(pid=20599): Terminated: ok {rc=0} 03:26:01.420374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20601): Launched 03:26:01.748843 run osmo-hlr_10.42.42.2(pid=20602): Launched 03:26:01.965323 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:02.571581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20604): Launched 03:26:02.898822 run osmo-stp_10.42.42.5(pid=20605): Launched 03:26:03.024224 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:03.630654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20607): Launched 03:26:03.958912 run osmo-msc_10.42.42.6(pid=20608): Launched 03:26:04.141255 run osmo-stp_10.42.42.5(pid=20605): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20605)] 03:26:04.279123 run osmo-stp_10.42.42.5(pid=20605): stdout: | (launched: 2022-12-10_03:26:02.839600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:04.419187 run osmo-stp_10.42.42.5(pid=20605): stderr: | [0;m[38;5;43m20221210032603032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032603033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032603033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032603033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:04.557128 run osmo-stp_10.42.42.5(pid=20605): stdout: | (launched: 2022-12-10_03:26:02.839600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:04.687488 run osmo-stp_10.42.42.5(pid=20605): stderr: | [0;m[38;5;43m20221210032603032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032603033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032603033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032603033 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032603034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:04.843233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20605): Process ended prematurely: osmo-stp_10.42.42.5(pid=20605) [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20605)] [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 03:26:04.851923 tst handover.py:18: Test FAILED (6.9 sec) 03:26:04.879460 run osmo-hlr_10.42.42.2(pid=20602): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20602)] 03:26:04.930122 run osmo-hlr_10.42.42.2(pid=20602): stdout: | (launched: 2022-12-10_03:26:01.690918) 03:26:04.982573 run osmo-hlr_10.42.42.2(pid=20602): stderr: | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032602047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032602062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032602070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032602070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032602070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:05.055378 run osmo-msc_10.42.42.6(pid=20608): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20608)] 03:26:05.105529 run osmo-msc_10.42.42.6(pid=20608): stdout: | (launched: 2022-12-10_03:26:03.899166) 03:26:05.157658 run osmo-msc_10.42.42.6(pid=20608): stderr: | [0;m[38;5;43m20221210032604225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032604225 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f35bff24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032604226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032604226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032604226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032604226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032604228 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032604228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032604228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032604228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:05.210056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20601): Terminating (SIGTERM) 03:26:05.251942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20604): Terminating (SIGTERM) 03:26:05.293953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20607): Terminating (SIGTERM) 03:26:05.336164 --- ParallelTerminationStrategy: PID 20601 died... 03:26:05.356536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20601): Terminated: ok {rc=0} 03:26:05.403125 --- ParallelTerminationStrategy: PID 20604 died... 03:26:05.422860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20604): Terminated: ok {rc=0} 03:26:05.468888 --- ParallelTerminationStrategy: PID 20607 died... 03:26:05.488705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20607): Terminated: ok {rc=0} 03:26:05.577342 bus /sierra_3: Setting Powered False 03:26:06.678555 bus /sierra_3: Setting Powered False 03:26:07.794503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 03:26:09.059455 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:09.064871 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:26:09.119588 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:26:09.146918 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:26:09.199710 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:26:09.253576 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:26:09.280725 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:26:09.833850 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 03:26:09.839210 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:09.850542 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:09.889084 tst handover.py: using LAC 25655 03:26:10.017159 tst handover.py: using RAC 155 03:26:10.145050 tst handover.py: using CellId 25655 03:26:10.275055 tst handover.py: using BVCI 25656 03:26:10.395840 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:10.447260 tst handover.py: using LAC 25656 03:26:10.575996 tst handover.py: using RAC 156 03:26:10.706069 tst handover.py: using CellId 25656 03:26:10.834455 tst handover.py: using BVCI 25657 03:26:10.954624 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:10.966093 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:10.977501 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:10.988526 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:11.000019 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:11.011175 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:11.129903 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:11.245731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:11.694483 run create_hlr_db(pid=20613): Launched 03:26:11.812527 bus /sierra_2: Setting Powered False 03:26:12.872647 run create_hlr_db(pid=20613): Terminated: ok {rc=0} 03:26:13.290515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Launched 03:26:13.619937 run osmo-hlr_10.42.42.2(pid=20616): Launched 03:26:13.745875 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:14.279524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Launched 03:26:14.606934 run osmo-stp_10.42.42.5(pid=20619): Launched 03:26:14.733578 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:15.297169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Launched 03:26:15.626258 run osmo-msc_10.42.42.6(pid=20622): Launched 03:26:15.811032 run osmo-stp_10.42.42.5(pid=20619): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] 03:26:16.059132 run osmo-stp_10.42.42.5(pid=20619): stdout: | (launched: 2022-12-10_03:26:14.547569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:16.240232 run osmo-stp_10.42.42.5(pid=20619): stderr: | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032614742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:16.380758 run osmo-stp_10.42.42.5(pid=20619): stdout: | (launched: 2022-12-10_03:26:14.547569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:16.508558 run osmo-stp_10.42.42.5(pid=20619): stderr: | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032614741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032614742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032614742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:16.664476 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20619): Process ended prematurely: osmo-stp_10.42.42.5(pid=20619) [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 03:26:16.673977 tst handover.py:18: Test FAILED (6.8 sec) 03:26:16.703871 run osmo-hlr_10.42.42.2(pid=20616): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20616)] 03:26:16.755123 run osmo-hlr_10.42.42.2(pid=20616): stdout: | (launched: 2022-12-10_03:26:13.559828) 03:26:16.808033 run osmo-hlr_10.42.42.2(pid=20616): stderr: | [0;m[1;31m20221210032613758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032613758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032613759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032613759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032613759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032613759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032613771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032613780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032613780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032613780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:16.882158 run osmo-msc_10.42.42.6(pid=20622): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20622)] 03:26:16.934069 run osmo-msc_10.42.42.6(pid=20622): stdout: | (launched: 2022-12-10_03:26:15.566660) 03:26:16.987100 run osmo-msc_10.42.42.6(pid=20622): stderr: | [0;m[38;5;43m20221210032615971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032615971 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde3c3b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032615971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032615972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032615972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032615972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032615974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032615974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032615974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032615974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:17.040925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Terminating (SIGTERM) 03:26:17.085612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Terminating (SIGTERM) 03:26:17.130906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Terminating (SIGTERM) 03:26:17.176788 --- ParallelTerminationStrategy: PID 20615 died... 03:26:17.197249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Terminated: ok {rc=0} 03:26:17.247068 --- ParallelTerminationStrategy: PID 20618 died... 03:26:17.268058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Terminated: ok {rc=0} 03:26:17.316085 --- ParallelTerminationStrategy: PID 20621 died... 03:26:17.335090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Terminated: ok {rc=0} 03:26:17.422103 bus /sierra_3: Setting Powered False 03:26:18.522625 bus /sierra_3: Setting Powered False 03:26:19.640737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 03:26:20.897377 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:20.902199 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:26:20.939637 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:26:20.966489 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:26:21.019349 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:26:21.056334 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:26:21.082692 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:26:21.630604 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 03:26:21.635669 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:21.646531 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:21.680852 tst handover.py: using LAC 25657 03:26:21.810851 tst handover.py: using RAC 157 03:26:21.941329 tst handover.py: using CellId 25657 03:26:22.073049 tst handover.py: using BVCI 25658 03:26:22.193205 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:22.227277 tst handover.py: using LAC 25658 03:26:22.355130 tst handover.py: using RAC 158 03:26:22.485922 tst handover.py: using CellId 25658 03:26:22.613354 tst handover.py: using BVCI 25659 03:26:22.734356 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:22.745609 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:22.756742 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:22.767848 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:22.778974 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:22.790167 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:22.906040 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:23.031414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:23.512657 run create_hlr_db(pid=20627): Launched 03:26:23.646020 bus /sierra_2: Setting Powered False 03:26:24.710835 run create_hlr_db(pid=20627): Terminated: ok {rc=0} 03:26:25.124041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Launched 03:26:25.431756 run osmo-hlr_10.42.42.2(pid=20630): Launched 03:26:25.549206 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:26.068019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20632): Launched 03:26:26.375851 run osmo-stp_10.42.42.5(pid=20633): Launched 03:26:26.493449 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:27.023292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20635): Launched 03:26:27.355648 run osmo-msc_10.42.42.6(pid=20636): Launched 03:26:27.540729 run osmo-stp_10.42.42.5(pid=20633): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20633)] 03:26:27.682041 run osmo-stp_10.42.42.5(pid=20633): stdout: | (launched: 2022-12-10_03:26:26.319868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:27.821572 run osmo-stp_10.42.42.5(pid=20633): stderr: | [0;m[38;5;43m20221210032626489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032626490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032626490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032626490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032626492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032626493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032626493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:27.960333 run osmo-stp_10.42.42.5(pid=20633): stdout: | (launched: 2022-12-10_03:26:26.319868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:28.091637 run osmo-stp_10.42.42.5(pid=20633): stderr: | [0;m[38;5;43m20221210032626489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032626490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032626490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032626490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032626492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032626493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032626493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:28.248758 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20633): Process ended prematurely: osmo-stp_10.42.42.5(pid=20633) [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20633)] [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 03:26:28.257743 tst handover.py:18: Test FAILED (6.6 sec) 03:26:28.285248 run osmo-hlr_10.42.42.2(pid=20630): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20630)] 03:26:28.335709 run osmo-hlr_10.42.42.2(pid=20630): stdout: | (launched: 2022-12-10_03:26:25.375671) 03:26:28.387654 run osmo-hlr_10.42.42.2(pid=20630): stderr: | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032625553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032625566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032625574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032625574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032625574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:28.459707 run osmo-msc_10.42.42.6(pid=20636): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20636)] 03:26:28.509528 run osmo-msc_10.42.42.6(pid=20636): stdout: | (launched: 2022-12-10_03:26:27.295878) 03:26:28.561270 run osmo-msc_10.42.42.6(pid=20636): stderr: | [0;m[38;5;43m20221210032627618 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032627618 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d6bc3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032627618 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032627619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032627619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032627619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032627621 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032627621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032627621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032627621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:28.613380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Terminating (SIGTERM) 03:26:28.655129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20632): Terminating (SIGTERM) 03:26:28.697012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20635): Terminating (SIGTERM) 03:26:28.739234 --- ParallelTerminationStrategy: PID 20629 died... 03:26:28.759483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20629): Terminated: ok {rc=0} 03:26:28.805942 --- ParallelTerminationStrategy: PID 20632 died... 03:26:28.825638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20632): Terminated: ok {rc=0} 03:26:28.871767 --- ParallelTerminationStrategy: PID 20635 died... 03:26:28.891388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20635): Terminated: ok {rc=0} 03:26:28.979339 bus /sierra_3: Setting Powered False 03:26:30.076083 bus /sierra_3: Setting Powered False 03:26:31.190276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 03:26:32.436527 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:32.442153 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:26:32.493579 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:26:32.520757 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:26:32.573697 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:26:32.624461 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:26:32.651534 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:26:33.201395 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 03:26:33.208450 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:33.220307 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:26:33.255882 tst handover.py: using LAC 25659 03:26:33.382931 tst handover.py: using RAC 159 03:26:33.509038 tst handover.py: using CellId 25659 03:26:33.635505 tst handover.py: using BVCI 25660 03:26:33.756081 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:26:33.804639 tst handover.py: using LAC 25660 03:26:33.930692 tst handover.py: using RAC 160 03:26:34.059079 tst handover.py: using CellId 25660 03:26:34.186098 tst handover.py: using BVCI 25661 03:26:34.305652 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:34.316889 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:34.327915 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:34.338990 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:34.350212 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:34.361392 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:26:34.480875 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:26:34.599758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:35.049960 run create_hlr_db(pid=20641): Launched 03:26:35.168257 bus /sierra_2: Setting Powered False 03:26:36.229391 run create_hlr_db(pid=20641): Terminated: ok {rc=0} 03:26:36.632059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Launched 03:26:36.939651 run osmo-hlr_10.42.42.2(pid=20644): Launched 03:26:37.057403 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:37.570582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Launched 03:26:37.878114 run osmo-stp_10.42.42.5(pid=20647): Launched 03:26:37.996324 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:38.525341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20649): Launched 03:26:38.833216 run osmo-msc_10.42.42.6(pid=20650): Launched 03:26:39.006540 run osmo-stp_10.42.42.5(pid=20647): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] 03:26:39.136774 run osmo-stp_10.42.42.5(pid=20647): stdout: | (launched: 2022-12-10_03:26:37.821938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:39.267961 run osmo-stp_10.42.42.5(pid=20647): stderr: | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032637993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:39.396519 run osmo-stp_10.42.42.5(pid=20647): stdout: | (launched: 2022-12-10_03:26:37.821938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:39.518593 run osmo-stp_10.42.42.5(pid=20647): stderr: | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032637993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032637993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032637994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:39.664360 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20647): Process ended prematurely: osmo-stp_10.42.42.5(pid=20647) [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 03:26:39.672861 tst handover.py:18: Test FAILED (6.5 sec) 03:26:39.699502 run osmo-hlr_10.42.42.2(pid=20644): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20644)] 03:26:39.747983 run osmo-hlr_10.42.42.2(pid=20644): stdout: | (launched: 2022-12-10_03:26:36.883782) 03:26:39.797930 run osmo-hlr_10.42.42.2(pid=20644): stderr: | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032637058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032637070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032637079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032637079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032637079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:39.867641 run osmo-msc_10.42.42.6(pid=20650): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20650)] 03:26:39.916467 run osmo-msc_10.42.42.6(pid=20650): stdout: | (launched: 2022-12-10_03:26:38.776339) 03:26:39.966792 run osmo-msc_10.42.42.6(pid=20650): stderr: | [0;m[38;5;43m20221210032639047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032639047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a9f55ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032639047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032639047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032639047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032639048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032639049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032639050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032639050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032639050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:40.017047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Terminating (SIGTERM) 03:26:40.057322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Terminating (SIGTERM) 03:26:40.097741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20649): Terminating (SIGTERM) 03:26:40.138559 --- ParallelTerminationStrategy: PID 20643 died... 03:26:40.157779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20643): Terminated: ok {rc=0} 03:26:40.202471 --- ParallelTerminationStrategy: PID 20646 died... 03:26:40.221672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20646): Terminated: ok {rc=0} 03:26:40.266224 --- ParallelTerminationStrategy: PID 20649 died... 03:26:40.284938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20649): Terminated: ok {rc=0} 03:26:40.372059 bus /sierra_3: Setting Powered False 03:26:41.472523 bus /sierra_3: Setting Powered False 03:26:42.588490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:26:43.845521 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:43.850708 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:26:43.897700 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:26:43.924458 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:26:43.974217 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:26:44.020256 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:26:44.046632 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:26:44.604512 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:26:44.609724 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:44.620661 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:26:44.655265 tst handover.py: using LAC 25661 03:26:44.785071 tst handover.py: using RAC 161 03:26:44.911495 tst handover.py: using CellId 25661 03:26:45.039422 tst handover.py: using BVCI 25662 03:26:45.160483 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:26:45.204701 tst handover.py: using LAC 25662 03:26:45.334580 tst handover.py: using RAC 162 03:26:45.461483 tst handover.py: using CellId 25662 03:26:45.588500 tst handover.py: using BVCI 25663 03:26:45.707562 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:45.718944 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:45.730246 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:45.741637 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:45.753060 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:45.764354 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:26:45.907864 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:26:46.029414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:46.516915 run create_hlr_db(pid=20655): Launched 03:26:46.682777 bus /sierra_2: Setting Powered False 03:26:47.747650 run create_hlr_db(pid=20655): Terminated: ok {rc=0} 03:26:48.175526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20657): Launched 03:26:48.504451 run osmo-hlr_10.42.42.2(pid=20658): Launched 03:26:48.629874 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:49.168010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20660): Launched 03:26:49.496805 run osmo-stp_10.42.42.5(pid=20661): Launched 03:26:49.622603 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:50.189650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20663): Launched 03:26:50.519775 run osmo-msc_10.42.42.6(pid=20664): Launched 03:26:50.703591 run osmo-stp_10.42.42.5(pid=20661): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20661)] 03:26:50.842042 run osmo-stp_10.42.42.5(pid=20661): stdout: | (launched: 2022-12-10_03:26:49.437489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:50.980889 run osmo-stp_10.42.42.5(pid=20661): stderr: | [0;m[38;5;43m20221210032649629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032649629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032649630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032649630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:51.119384 run osmo-stp_10.42.42.5(pid=20661): stdout: | (launched: 2022-12-10_03:26:49.437489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:51.249868 run osmo-stp_10.42.42.5(pid=20661): stderr: | [0;m[38;5;43m20221210032649629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032649629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032649630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032649630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032649631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:51.407228 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20661): Process ended prematurely: osmo-stp_10.42.42.5(pid=20661) [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20661)] [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 03:26:51.416102 tst handover.py:18: Test FAILED (6.8 sec) 03:26:51.443894 run osmo-hlr_10.42.42.2(pid=20658): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20658)] 03:26:51.494233 run osmo-hlr_10.42.42.2(pid=20658): stdout: | (launched: 2022-12-10_03:26:48.444606) 03:26:51.545981 run osmo-hlr_10.42.42.2(pid=20658): stderr: | [0;m[1;31m20221210032648645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032648645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032648645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032648645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032648646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032648646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032648659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032648669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032648670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032648670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:51.618222 run osmo-msc_10.42.42.6(pid=20664): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20664)] 03:26:51.669171 run osmo-msc_10.42.42.6(pid=20664): stdout: | (launched: 2022-12-10_03:26:50.459915) 03:26:51.720864 run osmo-msc_10.42.42.6(pid=20664): stderr: | [0;m[38;5;43m20221210032650787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032650787 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7effab879c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032650787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032650787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032650787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032650787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032650789 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032650790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032650790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032650790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:51.773355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20657): Terminating (SIGTERM) 03:26:51.815082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20660): Terminating (SIGTERM) 03:26:51.856644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20663): Terminating (SIGTERM) 03:26:51.898914 --- ParallelTerminationStrategy: PID 20657 died... 03:26:51.918376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20657): Terminated: ok {rc=0} 03:26:51.964303 --- ParallelTerminationStrategy: PID 20660 died... 03:26:51.983808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20660): Terminated: ok {rc=0} 03:26:52.029786 --- ParallelTerminationStrategy: PID 20663 died... 03:26:52.049307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20663): Terminated: ok {rc=0} 03:26:52.136124 bus /sierra_3: Setting Powered False 03:26:53.233495 bus /sierra_3: Setting Powered False 03:26:54.348866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:26:55.601914 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:55.606876 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:26:55.658016 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:26:55.685542 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:26:55.737191 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:26:55.787105 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:26:55.813467 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:26:56.365719 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:26:56.370889 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:56.381912 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:26:56.415895 tst handover.py: using LAC 25663 03:26:56.536728 tst handover.py: using RAC 163 03:26:56.666670 tst handover.py: using CellId 25663 03:26:56.790259 tst handover.py: using BVCI 25664 03:26:56.902019 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:26:56.950726 tst handover.py: using LAC 25664 03:26:57.073076 tst handover.py: using RAC 164 03:26:57.195119 tst handover.py: using CellId 25664 03:26:57.317118 tst handover.py: using BVCI 25665 03:26:57.431123 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:57.442174 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:57.452830 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:57.463859 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:57.475086 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:57.486535 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:26:57.606578 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:26:57.727062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:58.207253 run create_hlr_db(pid=20670): Launched 03:26:58.340078 bus /sierra_2: Setting Powered False 03:26:59.400772 run create_hlr_db(pid=20670): Terminated: ok {rc=0} 03:26:59.819869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20672): Launched 03:27:00.148745 run osmo-hlr_10.42.42.2(pid=20673): Launched 03:27:00.274487 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:00.814216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20675): Launched 03:27:01.145307 run osmo-stp_10.42.42.5(pid=20676): Launched 03:27:01.335044 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:02.036074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20678): Launched 03:27:02.366814 run osmo-msc_10.42.42.6(pid=20679): Launched 03:27:02.549315 run osmo-stp_10.42.42.5(pid=20676): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20676)] 03:27:02.687401 run osmo-stp_10.42.42.5(pid=20676): stdout: | (launched: 2022-12-10_03:27:01.087356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:02.826786 run osmo-stp_10.42.42.5(pid=20676): stderr: | [0;m[38;5;43m20221210032701413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032701413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032701414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032701414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032701414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032701415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032701415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:02.964547 run osmo-stp_10.42.42.5(pid=20676): stdout: | (launched: 2022-12-10_03:27:01.087356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:03.094775 run osmo-stp_10.42.42.5(pid=20676): stderr: | [0;m[38;5;43m20221210032701413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032701413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032701414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032701414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032701414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032701415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032701415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:03.250299 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20676): Process ended prematurely: osmo-stp_10.42.42.5(pid=20676) [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20676)] [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 03:27:03.259174 tst handover.py:18: Test FAILED (6.9 sec) 03:27:03.286585 run osmo-hlr_10.42.42.2(pid=20673): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20673)] 03:27:03.336478 run osmo-hlr_10.42.42.2(pid=20673): stdout: | (launched: 2022-12-10_03:27:00.089224) 03:27:03.388896 run osmo-hlr_10.42.42.2(pid=20673): stderr: | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032700289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032700300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032700308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032700308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032700308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:03.461152 run osmo-msc_10.42.42.6(pid=20679): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20679)] 03:27:03.511151 run osmo-msc_10.42.42.6(pid=20679): stdout: | (launched: 2022-12-10_03:27:02.307145) 03:27:03.563042 run osmo-msc_10.42.42.6(pid=20679): stderr: | [0;m[38;5;43m20221210032702633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032702633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2bfab33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032702633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032702633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032702633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032702633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032702635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032702635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032702636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032702636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:03.615026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20672): Terminating (SIGTERM) 03:27:03.656463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20675): Terminating (SIGTERM) 03:27:03.698222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20678): Terminating (SIGTERM) 03:27:03.740407 --- ParallelTerminationStrategy: PID 20672 died... 03:27:03.760494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20672): Terminated: ok {rc=0} 03:27:03.807239 --- ParallelTerminationStrategy: PID 20675 died... 03:27:03.826909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20675): Terminated: ok {rc=0} 03:27:03.873402 --- ParallelTerminationStrategy: PID 20678 died... 03:27:03.893111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20678): Terminated: ok {rc=0} 03:27:03.982530 bus /sierra_3: Setting Powered False 03:27:05.083271 bus /sierra_3: Setting Powered False 03:27:06.199033 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 03:27:07.459646 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:07.465611 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:27:07.504102 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:27:07.530714 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:27:07.589104 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:27:07.626966 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:27:07.653700 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:27:08.206586 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 03:27:08.213490 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:08.225565 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:08.264383 tst handover.py: using LAC 25665 03:27:08.385138 tst handover.py: using RAC 165 03:27:08.503582 tst handover.py: using CellId 25665 03:27:08.622240 tst handover.py: using BVCI 25666 03:27:08.735642 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:08.769664 tst handover.py: using LAC 25666 03:27:08.897486 tst handover.py: using RAC 166 03:27:09.019639 tst handover.py: using CellId 25666 03:27:09.143556 tst handover.py: using BVCI 25667 03:27:09.256006 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:09.266766 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:09.277326 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:09.288103 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:09.298927 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:09.309536 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:09.425053 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:09.544726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:10.025095 run create_hlr_db(pid=20684): Launched 03:27:10.160436 bus /sierra_2: Setting Powered False 03:27:11.225099 run create_hlr_db(pid=20684): Terminated: ok {rc=0} 03:27:11.636101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20686): Launched 03:27:11.945505 run osmo-hlr_10.42.42.2(pid=20687): Launched 03:27:12.064137 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:12.581602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20689): Launched 03:27:12.890196 run osmo-stp_10.42.42.5(pid=20690): Launched 03:27:13.008279 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:13.538549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20692): Launched 03:27:13.847164 run osmo-msc_10.42.42.6(pid=20693): Launched 03:27:14.019995 run osmo-stp_10.42.42.5(pid=20690): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20690)] 03:27:14.150793 run osmo-stp_10.42.42.5(pid=20690): stdout: | (launched: 2022-12-10_03:27:12.834022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:14.281123 run osmo-stp_10.42.42.5(pid=20690): stderr: | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032713005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:14.409685 run osmo-stp_10.42.42.5(pid=20690): stdout: | (launched: 2022-12-10_03:27:12.834022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:14.531511 run osmo-stp_10.42.42.5(pid=20690): stderr: | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032713004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032713005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032713005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:14.677245 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20690): Process ended prematurely: osmo-stp_10.42.42.5(pid=20690) [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20690)] [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 03:27:14.685484 tst handover.py:18: Test FAILED (6.5 sec) 03:27:14.711912 run osmo-hlr_10.42.42.2(pid=20687): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20687)] 03:27:14.760502 run osmo-hlr_10.42.42.2(pid=20687): stdout: | (launched: 2022-12-10_03:27:11.888883) 03:27:14.810223 run osmo-hlr_10.42.42.2(pid=20687): stderr: | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032712065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032712078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032712089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032712089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032712089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:14.879337 run osmo-msc_10.42.42.6(pid=20693): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20693)] 03:27:14.927348 run osmo-msc_10.42.42.6(pid=20693): stdout: | (launched: 2022-12-10_03:27:13.791217) 03:27:14.977052 run osmo-msc_10.42.42.6(pid=20693): stderr: | [0;m[38;5;43m20221210032714064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032714064 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd80838c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032714064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032714064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032714065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032714065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032714066 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032714067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032714067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032714067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:15.026976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20686): Terminating (SIGTERM) 03:27:15.066603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20689): Terminating (SIGTERM) 03:27:15.106574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20692): Terminating (SIGTERM) 03:27:15.146832 --- ParallelTerminationStrategy: PID 20686 died... 03:27:15.165960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20686): Terminated: ok {rc=0} 03:27:15.211196 --- ParallelTerminationStrategy: PID 20689 died... 03:27:15.229912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20689): Terminated: ok {rc=0} 03:27:15.274205 --- ParallelTerminationStrategy: PID 20692 died... 03:27:15.292937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20692): Terminated: ok {rc=0} 03:27:15.379492 bus /sierra_3: Setting Powered False 03:27:16.476278 bus /sierra_3: Setting Powered False 03:27:17.591515 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 03:27:18.834307 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:18.839837 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:27:18.891938 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:27:18.919645 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:27:18.973683 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:27:19.026220 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:27:19.053654 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:27:19.606726 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 03:27:19.612610 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:19.624096 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:19.660366 tst handover.py: using LAC 25667 03:27:19.783808 tst handover.py: using RAC 167 03:27:19.906742 tst handover.py: using CellId 25667 03:27:20.027202 tst handover.py: using BVCI 25668 03:27:20.140414 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:20.188814 tst handover.py: using LAC 25668 03:27:20.311304 tst handover.py: using RAC 168 03:27:20.434030 tst handover.py: using CellId 25668 03:27:20.555137 tst handover.py: using BVCI 25669 03:27:20.668349 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:20.679186 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:20.689829 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:20.700695 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:20.711632 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:20.722533 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:20.842640 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:20.959919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:21.407518 run create_hlr_db(pid=20698): Launched 03:27:21.525377 bus /sierra_2: Setting Powered False 03:27:22.586274 run create_hlr_db(pid=20698): Terminated: ok {rc=0} 03:27:23.005216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20700): Launched 03:27:23.336804 run osmo-hlr_10.42.42.2(pid=20701): Launched 03:27:23.462484 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:24.001659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20703): Launched 03:27:24.329897 run osmo-stp_10.42.42.5(pid=20704): Launched 03:27:24.456512 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:25.021746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20706): Launched 03:27:25.352266 run osmo-msc_10.42.42.6(pid=20707): Launched 03:27:25.536432 run osmo-stp_10.42.42.5(pid=20704): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20704)] 03:27:25.675033 run osmo-stp_10.42.42.5(pid=20704): stdout: | (launched: 2022-12-10_03:27:24.270634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:25.813424 run osmo-stp_10.42.42.5(pid=20704): stderr: | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032724466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:25.951249 run osmo-stp_10.42.42.5(pid=20704): stdout: | (launched: 2022-12-10_03:27:24.270634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:26.081421 run osmo-stp_10.42.42.5(pid=20704): stderr: | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032724466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032724466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032724467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:26.238275 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20704): Process ended prematurely: osmo-stp_10.42.42.5(pid=20704) [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20704)] [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 03:27:26.247305 tst handover.py:18: Test FAILED (6.6 sec) 03:27:26.274809 run osmo-hlr_10.42.42.2(pid=20701): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20701)] 03:27:26.325066 run osmo-hlr_10.42.42.2(pid=20701): stdout: | (launched: 2022-12-10_03:27:23.276756) 03:27:26.377248 run osmo-hlr_10.42.42.2(pid=20701): stderr: | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032723478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032723491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032723501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032723501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032723501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:26.450086 run osmo-msc_10.42.42.6(pid=20707): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20707)] 03:27:26.500140 run osmo-msc_10.42.42.6(pid=20707): stdout: | (launched: 2022-12-10_03:27:25.292270) 03:27:26.551456 run osmo-msc_10.42.42.6(pid=20707): stderr: | [0;m[38;5;43m20221210032725616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032725616 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01c1025c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032725616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032725616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032725616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032725616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032725618 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032725619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032725619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032725619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:26.603097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20700): Terminating (SIGTERM) 03:27:26.645065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20703): Terminating (SIGTERM) 03:27:26.686594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20706): Terminating (SIGTERM) 03:27:26.728337 --- ParallelTerminationStrategy: PID 20700 died... 03:27:26.748228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20700): Terminated: ok {rc=0} 03:27:26.794647 --- ParallelTerminationStrategy: PID 20703 died... 03:27:26.814153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20703): Terminated: ok {rc=0} 03:27:26.859957 --- ParallelTerminationStrategy: PID 20706 died... 03:27:26.879708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20706): Terminated: ok {rc=0} 03:27:26.967553 bus /sierra_3: Setting Powered False 03:27:28.066625 bus /sierra_3: Setting Powered False 03:27:29.183472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 03:27:30.439568 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:30.446632 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:27:30.498243 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:27:30.525609 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:27:30.578646 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:27:30.629884 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:27:30.657030 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:27:31.237423 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 03:27:31.245421 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:31.260324 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:27:31.302773 tst handover.py: using LAC 25669 03:27:31.446250 tst handover.py: using RAC 169 03:27:31.601346 tst handover.py: using CellId 25669 03:27:31.728631 tst handover.py: using BVCI 25670 03:27:31.843913 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:27:31.894259 tst handover.py: using LAC 25670 03:27:32.025905 tst handover.py: using RAC 170 03:27:32.155834 tst handover.py: using CellId 25670 03:27:32.291268 tst handover.py: using BVCI 25671 03:27:32.403219 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:32.414147 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:32.424865 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:32.436027 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:32.447511 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:32.458584 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:27:32.576127 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:27:32.697271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:33.177822 run create_hlr_db(pid=20712): Launched 03:27:33.312552 bus /sierra_2: Setting Powered False 03:27:34.377204 run create_hlr_db(pid=20712): Terminated: ok {rc=0} 03:27:34.791807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Launched 03:27:35.100899 run osmo-hlr_10.42.42.2(pid=20715): Launched 03:27:35.219662 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:35.737055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Launched 03:27:36.049273 run osmo-stp_10.42.42.5(pid=20719): Launched 03:27:36.166776 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:36.696547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20721): Launched 03:27:37.004929 run osmo-msc_10.42.42.6(pid=20722): Launched 03:27:37.177428 run osmo-stp_10.42.42.5(pid=20719): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20719)] 03:27:37.308895 run osmo-stp_10.42.42.5(pid=20719): stdout: | (launched: 2022-12-10_03:27:35.993265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:37.439282 run osmo-stp_10.42.42.5(pid=20719): stderr: | [0;m[38;5;43m20221210032736166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032736166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032736167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032736167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032736167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032736167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032736168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:37.568045 run osmo-stp_10.42.42.5(pid=20719): stdout: | (launched: 2022-12-10_03:27:35.993265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:37.690778 run osmo-stp_10.42.42.5(pid=20719): stderr: | [0;m[38;5;43m20221210032736166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032736166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032736167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032736167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032736167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032736167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032736168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:37.837340 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20719): Process ended prematurely: osmo-stp_10.42.42.5(pid=20719) [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20719)] [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 03:27:37.845685 tst handover.py:18: Test FAILED (6.6 sec) 03:27:37.872433 run osmo-hlr_10.42.42.2(pid=20715): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20715)] 03:27:37.920609 run osmo-hlr_10.42.42.2(pid=20715): stdout: | (launched: 2022-12-10_03:27:35.044177) 03:27:37.970549 run osmo-hlr_10.42.42.2(pid=20715): stderr: | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032735222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032735235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032735245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032735245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032735245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:38.039782 run osmo-msc_10.42.42.6(pid=20722): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20722)] 03:27:38.088020 run osmo-msc_10.42.42.6(pid=20722): stdout: | (launched: 2022-12-10_03:27:36.948632) 03:27:38.137711 run osmo-msc_10.42.42.6(pid=20722): stderr: | [0;m[38;5;43m20221210032737222 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032737223 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84cd069c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032737223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032737223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032737223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032737223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032737225 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032737225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032737225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032737226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:38.187996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminating (SIGTERM) 03:27:38.228108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminating (SIGTERM) 03:27:38.268388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20721): Terminating (SIGTERM) 03:27:38.308841 --- ParallelTerminationStrategy: PID 20714 died... 03:27:38.328204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminated: ok {rc=0} 03:27:38.372799 --- ParallelTerminationStrategy: PID 20717 died... 03:27:38.391572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminated: ok {rc=0} 03:27:38.436304 --- ParallelTerminationStrategy: PID 20721 died... 03:27:38.455104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20721): Terminated: ok {rc=0} 03:27:38.542034 bus /sierra_3: Setting Powered False 03:27:39.641765 bus /sierra_3: Setting Powered False 03:27:40.755852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 03:27:42.012663 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:42.018182 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:27:42.067979 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:27:42.095573 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:27:42.151014 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:27:42.200182 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:27:42.227052 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:27:42.777747 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 03:27:42.783286 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:42.794707 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:42.829455 tst handover.py: using LAC 25671 03:27:42.958469 tst handover.py: using RAC 171 03:27:43.080189 tst handover.py: using CellId 25671 03:27:43.200828 tst handover.py: using BVCI 25672 03:27:43.312111 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:43.359952 tst handover.py: using LAC 25672 03:27:43.490832 tst handover.py: using RAC 172 03:27:43.621062 tst handover.py: using CellId 25672 03:27:43.753204 tst handover.py: using BVCI 25673 03:27:43.873643 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:43.884913 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:43.896231 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:43.907309 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:43.918480 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:43.929537 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:44.051913 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:44.171947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:44.650587 run create_hlr_db(pid=20727): Launched 03:27:44.783427 bus /sierra_2: Setting Powered False 03:27:45.851698 run create_hlr_db(pid=20727): Terminated: ok {rc=0} 03:27:46.291214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20729): Launched 03:27:46.633697 run osmo-hlr_10.42.42.2(pid=20730): Launched 03:27:46.884112 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:47.534894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20732): Launched 03:27:47.864670 run osmo-stp_10.42.42.5(pid=20733): Launched 03:27:47.989503 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:48.556556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20735): Launched 03:27:48.884896 run osmo-msc_10.42.42.6(pid=20736): Launched 03:27:49.069237 run osmo-stp_10.42.42.5(pid=20733): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20733)] 03:27:49.206827 run osmo-stp_10.42.42.5(pid=20733): stdout: | (launched: 2022-12-10_03:27:47.804827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:49.345644 run osmo-stp_10.42.42.5(pid=20733): stderr: | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032747999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:49.483571 run osmo-stp_10.42.42.5(pid=20733): stdout: | (launched: 2022-12-10_03:27:47.804827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:49.613884 run osmo-stp_10.42.42.5(pid=20733): stderr: | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032747998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032747999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032748001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:49.770385 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20733): Process ended prematurely: osmo-stp_10.42.42.5(pid=20733) [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20733)] [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 03:27:49.779368 tst handover.py:18: Test FAILED (7.0 sec) 03:27:49.806551 run osmo-hlr_10.42.42.2(pid=20730): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20730)] 03:27:49.856144 run osmo-hlr_10.42.42.2(pid=20730): stdout: | (launched: 2022-12-10_03:27:46.562563) 03:27:49.907653 run osmo-hlr_10.42.42.2(pid=20730): stderr: | [0;m[1;31m20221210032746884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032746884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032746884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032746884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032746885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032746885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032746895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032746915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032746915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032746915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:49.979608 run osmo-msc_10.42.42.6(pid=20736): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20736)] 03:27:50.029447 run osmo-msc_10.42.42.6(pid=20736): stdout: | (launched: 2022-12-10_03:27:48.825525) 03:27:50.080787 run osmo-msc_10.42.42.6(pid=20736): stderr: | [0;m[38;5;43m20221210032749149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032749149 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f49dedccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032749149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032749149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032749149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032749150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032749151 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032749152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032749152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032749152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:50.132596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20729): Terminating (SIGTERM) 03:27:50.174086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20732): Terminating (SIGTERM) 03:27:50.215707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20735): Terminating (SIGTERM) 03:27:50.257367 --- ParallelTerminationStrategy: PID 20729 died... 03:27:50.277258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20729): Terminated: ok {rc=0} 03:27:50.323209 --- ParallelTerminationStrategy: PID 20732 died... 03:27:50.342849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20732): Terminated: ok {rc=0} 03:27:50.388777 --- ParallelTerminationStrategy: PID 20735 died... 03:27:50.408843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20735): Terminated: ok {rc=0} 03:27:50.496824 bus /sierra_3: Setting Powered False 03:27:51.596055 bus /sierra_3: Setting Powered False 03:27:52.712735 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:27:53.970362 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:53.975834 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:27:54.022160 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:27:54.049526 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:27:54.103788 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:27:54.149818 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:27:54.177113 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:27:54.730039 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:27:54.735921 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:54.747464 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:27:54.782494 tst handover.py: using LAC 25673 03:27:54.915693 tst handover.py: using RAC 173 03:27:55.043582 tst handover.py: using CellId 25673 03:27:55.172243 tst handover.py: using BVCI 25674 03:27:55.291364 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:27:55.335842 tst handover.py: using LAC 25674 03:27:55.462771 tst handover.py: using RAC 174 03:27:55.590158 tst handover.py: using CellId 25674 03:27:55.717567 tst handover.py: using BVCI 25675 03:27:55.839508 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:55.851019 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:55.862420 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:55.873891 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:55.885297 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:55.896535 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:27:56.016334 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:27:56.134549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:56.585475 run create_hlr_db(pid=20741): Launched 03:27:56.705054 bus /sierra_2: Setting Powered False 03:27:57.766626 run create_hlr_db(pid=20741): Terminated: ok {rc=0} 03:27:58.189068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20743): Launched 03:27:58.519185 run osmo-hlr_10.42.42.2(pid=20744): Launched 03:27:58.646429 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:59.184763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20746): Launched 03:27:59.513798 run osmo-stp_10.42.42.5(pid=20747): Launched 03:27:59.640444 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:00.209350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20749): Launched 03:28:00.539530 run osmo-msc_10.42.42.6(pid=20750): Launched 03:28:00.726696 run osmo-stp_10.42.42.5(pid=20747): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20747)] 03:28:00.910520 run osmo-stp_10.42.42.5(pid=20747): stdout: | (launched: 2022-12-10_03:27:59.454136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:01.090349 run osmo-stp_10.42.42.5(pid=20747): stderr: | [0;m[38;5;43m20221210032759648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032759648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032759649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032759649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032759649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032759650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032759650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:01.227756 run osmo-stp_10.42.42.5(pid=20747): stdout: | (launched: 2022-12-10_03:27:59.454136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:01.357855 run osmo-stp_10.42.42.5(pid=20747): stderr: | [0;m[38;5;43m20221210032759648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032759648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032759649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032759649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032759649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032759650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032759650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:01.512350 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20747): Process ended prematurely: osmo-stp_10.42.42.5(pid=20747) [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20747)] [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 03:28:01.522120 tst handover.py:18: Test FAILED (6.8 sec) 03:28:01.551878 run osmo-hlr_10.42.42.2(pid=20744): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20744)] 03:28:01.617311 run osmo-hlr_10.42.42.2(pid=20744): stdout: | (launched: 2022-12-10_03:27:58.459133) 03:28:01.681561 run osmo-hlr_10.42.42.2(pid=20744): stderr: | [0;m[1;31m20221210032758658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032758658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032758658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032758658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032758658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032758659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032758674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032758684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032758684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032758684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:01.774539 run osmo-msc_10.42.42.6(pid=20750): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20750)] 03:28:01.837439 run osmo-msc_10.42.42.6(pid=20750): stdout: | (launched: 2022-12-10_03:28:00.479817) 03:28:01.902981 run osmo-msc_10.42.42.6(pid=20750): stderr: | [0;m[38;5;43m20221210032800801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032800802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca84c4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032800802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032800802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032800802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032800802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032800804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032800804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032800805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032800805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:01.968764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20743): Terminating (SIGTERM) 03:28:02.024039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20746): Terminating (SIGTERM) 03:28:02.074732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20749): Terminating (SIGTERM) 03:28:02.128991 --- ParallelTerminationStrategy: PID 20743 died... 03:28:02.154320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20743): Terminated: ok {rc=0} 03:28:02.213545 --- ParallelTerminationStrategy: PID 20746 died... 03:28:02.235204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20746): Terminated: ok {rc=0} 03:28:02.281728 --- ParallelTerminationStrategy: PID 20749 died... 03:28:02.302338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20749): Terminated: ok {rc=0} 03:28:02.391005 bus /sierra_3: Setting Powered False 03:28:03.490058 bus /sierra_3: Setting Powered False 03:28:04.605981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:28:05.855063 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:05.860170 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:28:05.910107 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:28:05.937042 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:28:05.989778 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:28:06.039937 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:28:06.066282 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:28:06.616329 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:28:06.621551 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:06.632460 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:06.666801 tst handover.py: using LAC 25675 03:28:06.800468 tst handover.py: using RAC 175 03:28:06.929194 tst handover.py: using CellId 25675 03:28:07.059805 tst handover.py: using BVCI 25676 03:28:07.180732 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:07.230212 tst handover.py: using LAC 25676 03:28:07.359124 tst handover.py: using RAC 176 03:28:07.486380 tst handover.py: using CellId 25676 03:28:07.613386 tst handover.py: using BVCI 25677 03:28:07.733190 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:07.744621 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:07.756017 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:07.767887 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:07.779602 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:07.791387 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:07.907717 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:08.024476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:08.473051 run create_hlr_db(pid=20755): Launched 03:28:08.590078 bus /sierra_2: Setting Powered False 03:28:09.651276 run create_hlr_db(pid=20755): Terminated: ok {rc=0} 03:28:10.071507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20757): Launched 03:28:10.399470 run osmo-hlr_10.42.42.2(pid=20758): Launched 03:28:10.525907 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:11.063610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20760): Launched 03:28:11.394364 run osmo-stp_10.42.42.5(pid=20761): Launched 03:28:11.520568 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:12.087366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20763): Launched 03:28:12.417505 run osmo-msc_10.42.42.6(pid=20764): Launched 03:28:12.606262 run osmo-stp_10.42.42.5(pid=20761): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20761)] 03:28:12.746089 run osmo-stp_10.42.42.5(pid=20761): stdout: | (launched: 2022-12-10_03:28:11.335019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:12.886302 run osmo-stp_10.42.42.5(pid=20761): stderr: | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032811530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:13.024269 run osmo-stp_10.42.42.5(pid=20761): stdout: | (launched: 2022-12-10_03:28:11.335019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:13.155368 run osmo-stp_10.42.42.5(pid=20761): stderr: | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032811529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032811530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032811530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:13.311978 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20761): Process ended prematurely: osmo-stp_10.42.42.5(pid=20761) [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20761)] [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 03:28:13.320829 tst handover.py:18: Test FAILED (6.7 sec) 03:28:13.348489 run osmo-hlr_10.42.42.2(pid=20758): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20758)] 03:28:13.398590 run osmo-hlr_10.42.42.2(pid=20758): stdout: | (launched: 2022-12-10_03:28:10.339573) 03:28:13.450765 run osmo-hlr_10.42.42.2(pid=20758): stderr: | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032810539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032810552 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032810562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032810562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032810562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:13.523375 run osmo-msc_10.42.42.6(pid=20764): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20764)] 03:28:13.573446 run osmo-msc_10.42.42.6(pid=20764): stdout: | (launched: 2022-12-10_03:28:12.357801) 03:28:13.624881 run osmo-msc_10.42.42.6(pid=20764): stderr: | [0;m[38;5;43m20221210032812683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032812683 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa742793c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032812683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032812683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032812683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032812683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032812685 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032812685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032812686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032812686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:13.676802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20757): Terminating (SIGTERM) 03:28:13.718291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20760): Terminating (SIGTERM) 03:28:13.760095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20763): Terminating (SIGTERM) 03:28:13.802367 --- ParallelTerminationStrategy: PID 20757 died... 03:28:13.822455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20757): Terminated: ok {rc=0} 03:28:13.868907 --- ParallelTerminationStrategy: PID 20760 died... 03:28:13.889048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20760): Terminated: ok {rc=0} 03:28:13.935328 --- ParallelTerminationStrategy: PID 20763 died... 03:28:13.955445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20763): Terminated: ok {rc=0} 03:28:14.043914 bus /sierra_3: Setting Powered False 03:28:15.141531 bus /sierra_3: Setting Powered False 03:28:16.264533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 03:28:17.532275 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:17.537341 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:28:17.575251 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:28:17.602027 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:28:17.655306 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:28:17.691953 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:28:17.718353 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:28:18.266492 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 03:28:18.271645 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:18.282508 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:18.316413 tst handover.py: using LAC 25677 03:28:18.436871 tst handover.py: using RAC 177 03:28:18.557441 tst handover.py: using CellId 25677 03:28:18.688569 tst handover.py: using BVCI 25678 03:28:18.809877 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:18.846275 tst handover.py: using LAC 25678 03:28:18.976642 tst handover.py: using RAC 178 03:28:19.105634 tst handover.py: using CellId 25678 03:28:19.236104 tst handover.py: using BVCI 25679 03:28:19.356122 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:19.367563 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:19.378647 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:19.389996 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:19.401360 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:19.412480 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:19.532001 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:19.652091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:20.132366 run create_hlr_db(pid=20769): Launched 03:28:20.266413 bus /sierra_2: Setting Powered False 03:28:21.330864 run create_hlr_db(pid=20769): Terminated: ok {rc=0} 03:28:21.759769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20771): Launched 03:28:22.089827 run osmo-hlr_10.42.42.2(pid=20772): Launched 03:28:22.215477 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:22.754603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20774): Launched 03:28:23.082362 run osmo-stp_10.42.42.5(pid=20775): Launched 03:28:23.210427 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:23.775621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20777): Launched 03:28:24.105304 run osmo-msc_10.42.42.6(pid=20778): Launched 03:28:24.291207 run osmo-stp_10.42.42.5(pid=20775): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20775)] 03:28:24.429912 run osmo-stp_10.42.42.5(pid=20775): stdout: | (launched: 2022-12-10_03:28:23.022618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:24.569268 run osmo-stp_10.42.42.5(pid=20775): stderr: | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032823215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:24.707012 run osmo-stp_10.42.42.5(pid=20775): stdout: | (launched: 2022-12-10_03:28:23.022618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:24.837095 run osmo-stp_10.42.42.5(pid=20775): stderr: | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032823214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032823215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032823215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:24.993331 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20775): Process ended prematurely: osmo-stp_10.42.42.5(pid=20775) [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20775)] [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 03:28:25.002439 tst handover.py:18: Test FAILED (6.7 sec) 03:28:25.029946 run osmo-hlr_10.42.42.2(pid=20772): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20772)] 03:28:25.079726 run osmo-hlr_10.42.42.2(pid=20772): stdout: | (launched: 2022-12-10_03:28:22.030193) 03:28:25.131607 run osmo-hlr_10.42.42.2(pid=20772): stderr: | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032822231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032822246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032822256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032822256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032822256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:25.203758 run osmo-msc_10.42.42.6(pid=20778): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20778)] 03:28:25.253515 run osmo-msc_10.42.42.6(pid=20778): stdout: | (launched: 2022-12-10_03:28:24.045524) 03:28:25.305156 run osmo-msc_10.42.42.6(pid=20778): stderr: | [0;m[38;5;43m20221210032824370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032824370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9def9c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032824370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032824370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032824370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032824371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032824372 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032824373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032824373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032824373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:25.357043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20771): Terminating (SIGTERM) 03:28:25.398684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20774): Terminating (SIGTERM) 03:28:25.440514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20777): Terminating (SIGTERM) 03:28:25.482760 --- ParallelTerminationStrategy: PID 20771 died... 03:28:25.502750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20771): Terminated: ok {rc=0} 03:28:25.549079 --- ParallelTerminationStrategy: PID 20774 died... 03:28:25.568647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20774): Terminated: ok {rc=0} 03:28:25.614219 --- ParallelTerminationStrategy: PID 20777 died... 03:28:25.633780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20777): Terminated: ok {rc=0} 03:28:25.721607 bus /sierra_3: Setting Powered False 03:28:26.821587 bus /sierra_3: Setting Powered False 03:28:27.937861 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 03:28:29.182947 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:29.188573 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:28:29.238999 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:28:29.266398 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:28:29.319147 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:28:29.368661 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:28:29.395866 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:28:29.948305 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 03:28:29.954131 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:29.965504 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:28:30.004398 tst handover.py: using LAC 25679 03:28:30.133580 tst handover.py: using RAC 179 03:28:30.255393 tst handover.py: using CellId 25679 03:28:30.374160 tst handover.py: using BVCI 25680 03:28:30.487543 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:28:30.533616 tst handover.py: using LAC 25680 03:28:30.654131 tst handover.py: using RAC 180 03:28:30.774941 tst handover.py: using CellId 25680 03:28:30.927201 tst handover.py: using BVCI 25681 03:28:31.055142 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:31.068483 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:31.080616 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:31.093270 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:31.105209 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:31.116942 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:28:31.240173 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:28:31.363680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:31.903265 run create_hlr_db(pid=20784): Launched 03:28:32.063870 bus /sierra_2: Setting Powered False 03:28:33.123294 run create_hlr_db(pid=20784): Terminated: ok {rc=0} 03:28:33.524328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20786): Launched 03:28:33.831371 run osmo-hlr_10.42.42.2(pid=20787): Launched 03:28:33.949012 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:34.467573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20789): Launched 03:28:34.774875 run osmo-stp_10.42.42.5(pid=20790): Launched 03:28:34.892553 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:35.420153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20792): Launched 03:28:35.727440 run osmo-msc_10.42.42.6(pid=20793): Launched 03:28:35.899338 run osmo-stp_10.42.42.5(pid=20790): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20790)] 03:28:36.029880 run osmo-stp_10.42.42.5(pid=20790): stdout: | (launched: 2022-12-10_03:28:34.719116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:36.160434 run osmo-stp_10.42.42.5(pid=20790): stderr: | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032834890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:36.288924 run osmo-stp_10.42.42.5(pid=20790): stdout: | (launched: 2022-12-10_03:28:34.719116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:36.410933 run osmo-stp_10.42.42.5(pid=20790): stderr: | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032834890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032834890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032834891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:36.557782 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20790): Process ended prematurely: osmo-stp_10.42.42.5(pid=20790) [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20790)] [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 03:28:36.566029 tst handover.py:18: Test FAILED (6.6 sec) 03:28:36.592224 run osmo-hlr_10.42.42.2(pid=20787): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20787)] 03:28:36.640156 run osmo-hlr_10.42.42.2(pid=20787): stdout: | (launched: 2022-12-10_03:28:33.775240) 03:28:36.689654 run osmo-hlr_10.42.42.2(pid=20787): stderr: | [0;m[1;31m20221210032833953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032833953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032833953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032833953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032833953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032833954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032833966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032833977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032833977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032833977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:36.758299 run osmo-msc_10.42.42.6(pid=20793): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20793)] 03:28:36.805660 run osmo-msc_10.42.42.6(pid=20793): stdout: | (launched: 2022-12-10_03:28:35.671465) 03:28:36.854795 run osmo-msc_10.42.42.6(pid=20793): stderr: | [0;m[38;5;43m20221210032835948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032835948 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50add39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032835948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032835948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032835949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032835949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032835950 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032835951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032835951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032835951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:36.904226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20786): Terminating (SIGTERM) 03:28:36.943711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20789): Terminating (SIGTERM) 03:28:36.983553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20792): Terminating (SIGTERM) 03:28:37.023498 --- ParallelTerminationStrategy: PID 20786 died... 03:28:37.042442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20786): Terminated: ok {rc=0} 03:28:37.086491 --- ParallelTerminationStrategy: PID 20789 died... 03:28:37.104824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20789): Terminated: ok {rc=0} 03:28:37.149170 --- ParallelTerminationStrategy: PID 20792 died... 03:28:37.167722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20792): Terminated: ok {rc=0} 03:28:37.251694 bus /sierra_3: Setting Powered False 03:28:38.349465 bus /sierra_3: Setting Powered False 03:28:39.465105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 03:28:40.719722 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:40.724883 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:28:40.774215 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:28:40.800882 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:28:40.853507 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:28:40.902913 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:28:40.929628 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:28:41.478401 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 03:28:41.483621 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:41.494465 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:41.527681 tst handover.py: using LAC 25681 03:28:41.647793 tst handover.py: using RAC 181 03:28:41.783680 tst handover.py: using CellId 25681 03:28:41.909913 tst handover.py: using BVCI 25682 03:28:42.022838 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:42.070296 tst handover.py: using LAC 25682 03:28:42.191459 tst handover.py: using RAC 182 03:28:42.312348 tst handover.py: using CellId 25682 03:28:42.432678 tst handover.py: using BVCI 25683 03:28:42.544690 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:42.555526 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:42.566246 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:42.577199 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:42.588143 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:42.598979 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:42.719811 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:42.838568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:43.319559 run create_hlr_db(pid=20798): Launched 03:28:43.453411 bus /sierra_2: Setting Powered False 03:28:44.518278 run create_hlr_db(pid=20798): Terminated: ok {rc=0} 03:28:44.932490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20800): Launched 03:28:45.240837 run osmo-hlr_10.42.42.2(pid=20801): Launched 03:28:45.359986 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:45.917866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20803): Launched 03:28:46.246454 run osmo-stp_10.42.42.5(pid=20804): Launched 03:28:46.547003 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:47.153141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20806): Launched 03:28:47.470295 run osmo-msc_10.42.42.6(pid=20807): Launched 03:28:47.648110 run osmo-stp_10.42.42.5(pid=20804): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20804)] 03:28:47.783613 run osmo-stp_10.42.42.5(pid=20804): stdout: | (launched: 2022-12-10_03:28:46.185622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:47.914965 run osmo-stp_10.42.42.5(pid=20804): stderr: | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032846376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:48.044455 run osmo-stp_10.42.42.5(pid=20804): stdout: | (launched: 2022-12-10_03:28:46.185622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:48.167337 run osmo-stp_10.42.42.5(pid=20804): stderr: | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032846375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032846376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032846379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:48.315147 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20804): Process ended prematurely: osmo-stp_10.42.42.5(pid=20804) [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20804)] [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 03:28:48.323337 tst handover.py:18: Test FAILED (6.8 sec) 03:28:48.349552 run osmo-hlr_10.42.42.2(pid=20801): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20801)] 03:28:48.397337 run osmo-hlr_10.42.42.2(pid=20801): stdout: | (launched: 2022-12-10_03:28:45.184167) 03:28:48.446501 run osmo-hlr_10.42.42.2(pid=20801): stderr: | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032845364 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032845376 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032845384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032845384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032845384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:48.515014 run osmo-msc_10.42.42.6(pid=20807): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20807)] 03:28:48.562503 run osmo-msc_10.42.42.6(pid=20807): stdout: | (launched: 2022-12-10_03:28:47.412826) 03:28:48.611663 run osmo-msc_10.42.42.6(pid=20807): stderr: | [0;m[38;5;43m20221210032847684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032847684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5292696c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032847684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032847684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032847684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032847685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032847688 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032847688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032847689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032847689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:48.661262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20800): Terminating (SIGTERM) 03:28:48.700811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20803): Terminating (SIGTERM) 03:28:48.740498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20806): Terminating (SIGTERM) 03:28:48.780592 --- ParallelTerminationStrategy: PID 20800 died... 03:28:48.799743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20800): Terminated: ok {rc=0} 03:28:48.844346 --- ParallelTerminationStrategy: PID 20803 died... 03:28:48.862846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20803): Terminated: ok {rc=0} 03:28:48.906713 --- ParallelTerminationStrategy: PID 20806 died... 03:28:48.925144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20806): Terminated: ok {rc=0} 03:28:49.011626 bus /sierra_3: Setting Powered False 03:28:50.114262 bus /sierra_3: Setting Powered False 03:28:51.230227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:28:52.482097 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:52.488763 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:28:52.549456 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:28:52.576845 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:28:52.629151 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:28:52.689397 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:28:52.716706 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:28:53.271179 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:28:53.276517 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:53.288051 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:53.337046 tst handover.py: using LAC 25683 03:28:53.464060 tst handover.py: using RAC 183 03:28:53.583851 tst handover.py: using CellId 25683 03:28:53.703179 tst handover.py: using BVCI 25684 03:28:53.816159 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:53.858897 tst handover.py: using LAC 25684 03:28:53.978191 tst handover.py: using RAC 184 03:28:54.098936 tst handover.py: using CellId 25684 03:28:54.218199 tst handover.py: using BVCI 25685 03:28:54.332346 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:54.343420 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:54.354770 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:54.365973 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:54.377157 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:54.388095 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:54.504778 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:54.623432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:55.072227 run create_hlr_db(pid=20813): Launched 03:28:55.190727 bus /sierra_2: Setting Powered False 03:28:56.251555 run create_hlr_db(pid=20813): Terminated: ok {rc=0} 03:28:56.672656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Launched 03:28:57.001234 run osmo-hlr_10.42.42.2(pid=20816): Launched 03:28:57.126993 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:57.668372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Launched 03:28:57.997337 run osmo-stp_10.42.42.5(pid=20819): Launched 03:28:58.123111 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:58.687881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Launched 03:28:59.016109 run osmo-msc_10.42.42.6(pid=20822): Launched 03:28:59.200039 run osmo-stp_10.42.42.5(pid=20819): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] 03:28:59.338518 run osmo-stp_10.42.42.5(pid=20819): stdout: | (launched: 2022-12-10_03:28:57.937897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:59.478091 run osmo-stp_10.42.42.5(pid=20819): stderr: | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032858130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:59.615846 run osmo-stp_10.42.42.5(pid=20819): stdout: | (launched: 2022-12-10_03:28:57.937897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:59.746475 run osmo-stp_10.42.42.5(pid=20819): stderr: | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032858130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032858130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032858131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:59.902663 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20819): Process ended prematurely: osmo-stp_10.42.42.5(pid=20819) [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 03:28:59.911469 tst handover.py:18: Test FAILED (6.6 sec) 03:28:59.939044 run osmo-hlr_10.42.42.2(pid=20816): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20816)] 03:28:59.988830 run osmo-hlr_10.42.42.2(pid=20816): stdout: | (launched: 2022-12-10_03:28:56.941380) 03:29:00.040447 run osmo-hlr_10.42.42.2(pid=20816): stderr: | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032857142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032857155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032857163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032857163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032857163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:00.112369 run osmo-msc_10.42.42.6(pid=20822): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20822)] 03:29:00.162144 run osmo-msc_10.42.42.6(pid=20822): stdout: | (launched: 2022-12-10_03:28:58.956243) 03:29:00.213555 run osmo-msc_10.42.42.6(pid=20822): stderr: | [0;m[38;5;43m20221210032859280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032859281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb5759b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032859281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032859281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032859281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032859281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032859283 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032859283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032859283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032859283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:00.265484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Terminating (SIGTERM) 03:29:00.306977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Terminating (SIGTERM) 03:29:00.348879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Terminating (SIGTERM) 03:29:00.390554 --- ParallelTerminationStrategy: PID 20815 died... 03:29:00.410081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Terminated: ok {rc=0} 03:29:00.456379 --- ParallelTerminationStrategy: PID 20818 died... 03:29:00.475796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Terminated: ok {rc=0} 03:29:00.521536 --- ParallelTerminationStrategy: PID 20821 died... 03:29:00.541058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Terminated: ok {rc=0} 03:29:00.628269 bus /sierra_3: Setting Powered False 03:29:01.737633 bus /sierra_3: Setting Powered False 03:29:02.868581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:29:04.135358 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:04.140467 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:29:04.203597 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:29:04.230375 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:29:04.283657 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:29:04.347931 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:29:04.374713 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:29:04.923087 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:29:04.928274 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:04.939342 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:04.986192 tst handover.py: using LAC 25685 03:29:05.108614 tst handover.py: using RAC 185 03:29:05.229667 tst handover.py: using CellId 25685 03:29:05.358874 tst handover.py: using BVCI 25686 03:29:05.479929 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:05.530533 tst handover.py: using LAC 25686 03:29:05.659882 tst handover.py: using RAC 186 03:29:05.790291 tst handover.py: using CellId 25686 03:29:05.919962 tst handover.py: using BVCI 25687 03:29:06.040708 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:06.052196 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:06.063557 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:06.074932 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:06.086292 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:06.097711 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:06.214368 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:06.331515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:06.782707 run create_hlr_db(pid=20827): Launched 03:29:06.902346 bus /sierra_2: Setting Powered False 03:29:07.963793 run create_hlr_db(pid=20827): Terminated: ok {rc=0} 03:29:08.367659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20829): Launched 03:29:08.676544 run osmo-hlr_10.42.42.2(pid=20830): Launched 03:29:08.794172 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:09.312471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20832): Launched 03:29:09.620556 run osmo-stp_10.42.42.5(pid=20833): Launched 03:29:09.738235 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:10.281766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20835): Launched 03:29:10.591182 run osmo-msc_10.42.42.6(pid=20836): Launched 03:29:10.763554 run osmo-stp_10.42.42.5(pid=20833): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20833)] 03:29:10.894451 run osmo-stp_10.42.42.5(pid=20833): stdout: | (launched: 2022-12-10_03:29:09.564325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:11.025362 run osmo-stp_10.42.42.5(pid=20833): stderr: | [0;m[38;5;43m20221210032909737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032909738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032909738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032909738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:11.154198 run osmo-stp_10.42.42.5(pid=20833): stdout: | (launched: 2022-12-10_03:29:09.564325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:11.276002 run osmo-stp_10.42.42.5(pid=20833): stderr: | [0;m[38;5;43m20221210032909737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032909738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032909738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032909738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032909739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:11.422194 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20833): Process ended prematurely: osmo-stp_10.42.42.5(pid=20833) [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20833)] [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 03:29:11.430415 tst handover.py:18: Test FAILED (6.5 sec) 03:29:11.457033 run osmo-hlr_10.42.42.2(pid=20830): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20830)] 03:29:11.505652 run osmo-hlr_10.42.42.2(pid=20830): stdout: | (launched: 2022-12-10_03:29:08.620399) 03:29:11.555803 run osmo-hlr_10.42.42.2(pid=20830): stderr: | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032908796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032908810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032908818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032908818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032908818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:11.625816 run osmo-msc_10.42.42.6(pid=20836): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20836)] 03:29:11.674272 run osmo-msc_10.42.42.6(pid=20836): stdout: | (launched: 2022-12-10_03:29:10.535175) 03:29:11.724268 run osmo-msc_10.42.42.6(pid=20836): stderr: | [0;m[38;5;43m20221210032910808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032910808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecc26f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032910808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032910808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032910808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032910808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032910810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032910811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032910811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032910811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:11.774637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20829): Terminating (SIGTERM) 03:29:11.814968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20832): Terminating (SIGTERM) 03:29:11.855513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20835): Terminating (SIGTERM) 03:29:11.896036 --- ParallelTerminationStrategy: PID 20829 died... 03:29:11.915428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20829): Terminated: ok {rc=0} 03:29:11.960282 --- ParallelTerminationStrategy: PID 20832 died... 03:29:11.979161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20832): Terminated: ok {rc=0} 03:29:12.023802 --- ParallelTerminationStrategy: PID 20835 died... 03:29:12.042583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20835): Terminated: ok {rc=0} 03:29:12.128102 bus /sierra_3: Setting Powered False 03:29:13.226846 bus /sierra_3: Setting Powered False 03:29:14.342777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 03:29:15.619078 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:15.624848 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:29:15.676679 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:29:15.704265 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:29:15.757768 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:29:15.809699 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:29:15.840582 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:29:16.406975 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 03:29:16.414034 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:16.426170 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:16.482451 tst handover.py: using LAC 25687 03:29:16.613065 tst handover.py: using RAC 187 03:29:16.776301 tst handover.py: using CellId 25687 03:29:16.940617 tst handover.py: using BVCI 25688 03:29:17.054158 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:17.090233 tst handover.py: using LAC 25688 03:29:17.222437 tst handover.py: using RAC 188 03:29:17.358838 tst handover.py: using CellId 25688 03:29:17.478680 tst handover.py: using BVCI 25689 03:29:17.591545 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:17.602376 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:17.613133 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:17.623977 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:17.635033 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:17.645863 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:17.764099 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:17.883252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:18.363623 run create_hlr_db(pid=20841): Launched 03:29:18.498281 bus /sierra_2: Setting Powered False 03:29:19.562990 run create_hlr_db(pid=20841): Terminated: ok {rc=0} 03:29:19.975436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Launched 03:29:20.306558 run osmo-hlr_10.42.42.2(pid=20844): Launched 03:29:20.432528 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:20.970634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20846): Launched 03:29:21.300917 run osmo-stp_10.42.42.5(pid=20847): Launched 03:29:21.428103 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:21.994224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20849): Launched 03:29:22.322719 run osmo-msc_10.42.42.6(pid=20850): Launched 03:29:22.507372 run osmo-stp_10.42.42.5(pid=20847): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20847)] 03:29:22.646121 run osmo-stp_10.42.42.5(pid=20847): stdout: | (launched: 2022-12-10_03:29:21.241396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:22.785521 run osmo-stp_10.42.42.5(pid=20847): stderr: | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032921437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:22.923361 run osmo-stp_10.42.42.5(pid=20847): stdout: | (launched: 2022-12-10_03:29:21.241396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:23.053603 run osmo-stp_10.42.42.5(pid=20847): stderr: | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032921436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032921437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032921437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:23.209857 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20847): Process ended prematurely: osmo-stp_10.42.42.5(pid=20847) [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20847)] [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 03:29:23.218717 tst handover.py:18: Test FAILED (6.8 sec) 03:29:23.246391 run osmo-hlr_10.42.42.2(pid=20844): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20844)] 03:29:23.296722 run osmo-hlr_10.42.42.2(pid=20844): stdout: | (launched: 2022-12-10_03:29:20.246833) 03:29:23.348658 run osmo-hlr_10.42.42.2(pid=20844): stderr: | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032920445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032920459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032920470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032920470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032920470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:23.421203 run osmo-msc_10.42.42.6(pid=20850): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20850)] 03:29:23.471653 run osmo-msc_10.42.42.6(pid=20850): stdout: | (launched: 2022-12-10_03:29:22.263197) 03:29:23.523589 run osmo-msc_10.42.42.6(pid=20850): stderr: | [0;m[38;5;43m20221210032922585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032922586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a78bcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032922586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032922586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032922586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032922586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032922588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032922588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032922588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032922588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:23.575772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Terminating (SIGTERM) 03:29:23.617595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20846): Terminating (SIGTERM) 03:29:23.659537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20849): Terminating (SIGTERM) 03:29:23.701693 --- ParallelTerminationStrategy: PID 20843 died... 03:29:23.721789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Terminated: ok {rc=0} 03:29:23.767897 --- ParallelTerminationStrategy: PID 20846 died... 03:29:23.787498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20846): Terminated: ok {rc=0} 03:29:23.833471 --- ParallelTerminationStrategy: PID 20849 died... 03:29:23.853016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20849): Terminated: ok {rc=0} 03:29:23.941239 bus /sierra_3: Setting Powered False 03:29:25.039915 bus /sierra_3: Setting Powered False 03:29:26.155440 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 03:29:27.414226 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:27.420130 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:29:27.484711 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:29:27.512339 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:29:27.566970 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:29:27.631685 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:29:27.658999 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:29:28.209272 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 03:29:28.214627 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:28.225930 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:28.274785 tst handover.py: using LAC 25689 03:29:28.403265 tst handover.py: using RAC 189 03:29:28.534387 tst handover.py: using CellId 25689 03:29:28.665328 tst handover.py: using BVCI 25690 03:29:28.777484 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:28.823906 tst handover.py: using LAC 25690 03:29:28.943138 tst handover.py: using RAC 190 03:29:29.063589 tst handover.py: using CellId 25690 03:29:29.182572 tst handover.py: using BVCI 25691 03:29:29.295160 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:29.306060 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:29.316769 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:29.327853 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:29.338761 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:29.349782 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:29.471192 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:29.586692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:30.036919 run create_hlr_db(pid=20855): Launched 03:29:30.155171 bus /sierra_2: Setting Powered False 03:29:31.236511 run create_hlr_db(pid=20855): Terminated: ok {rc=0} 03:29:31.665751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20857): Launched 03:29:32.017719 run osmo-hlr_10.42.42.2(pid=20858): Launched 03:29:32.257983 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:32.798870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20860): Launched 03:29:33.129830 run osmo-stp_10.42.42.5(pid=20861): Launched 03:29:33.257134 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:33.829614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20863): Launched 03:29:34.160753 run osmo-msc_10.42.42.6(pid=20864): Launched 03:29:34.345287 run osmo-stp_10.42.42.5(pid=20861): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20861)] 03:29:34.483658 run osmo-stp_10.42.42.5(pid=20861): stdout: | (launched: 2022-12-10_03:29:33.070242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:34.623602 run osmo-stp_10.42.42.5(pid=20861): stderr: | [0;m[38;5;43m20221210032933263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032933264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032933264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032933264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:34.762198 run osmo-stp_10.42.42.5(pid=20861): stdout: | (launched: 2022-12-10_03:29:33.070242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:34.893137 run osmo-stp_10.42.42.5(pid=20861): stderr: | [0;m[38;5;43m20221210032933263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032933264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032933264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032933264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032933265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:35.049871 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20861): Process ended prematurely: osmo-stp_10.42.42.5(pid=20861) [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20861)] [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 03:29:35.058552 tst handover.py:18: Test FAILED (6.8 sec) 03:29:35.085882 run osmo-hlr_10.42.42.2(pid=20858): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20858)] 03:29:35.135778 run osmo-hlr_10.42.42.2(pid=20858): stdout: | (launched: 2022-12-10_03:29:31.951026) 03:29:35.187658 run osmo-hlr_10.42.42.2(pid=20858): stderr: | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032932191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032932211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032932227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032932227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032932227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:35.259774 run osmo-msc_10.42.42.6(pid=20864): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20864)] 03:29:35.309641 run osmo-msc_10.42.42.6(pid=20864): stdout: | (launched: 2022-12-10_03:29:34.100219) 03:29:35.361289 run osmo-msc_10.42.42.6(pid=20864): stderr: | [0;m[38;5;43m20221210032934423 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032934423 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cc9f51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032934424 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032934424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032934424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032934424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032934426 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032934426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032934426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032934426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:35.413571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20857): Terminating (SIGTERM) 03:29:35.455354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20860): Terminating (SIGTERM) 03:29:35.497526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20863): Terminating (SIGTERM) 03:29:35.539755 --- ParallelTerminationStrategy: PID 20857 died... 03:29:35.559877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20857): Terminated: ok {rc=0} 03:29:35.606501 --- ParallelTerminationStrategy: PID 20860 died... 03:29:35.626187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20860): Terminated: ok {rc=0} 03:29:35.672468 --- ParallelTerminationStrategy: PID 20863 died... 03:29:35.692591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20863): Terminated: ok {rc=0} 03:29:35.781008 bus /sierra_3: Setting Powered False 03:29:36.880776 bus /sierra_3: Setting Powered False 03:29:37.996636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 03:29:39.271206 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:39.277267 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:29:39.340799 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:29:39.368447 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:29:39.423476 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:29:39.488155 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:29:39.515602 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:29:40.064692 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 03:29:40.070126 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:40.081473 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:40.129466 tst handover.py: using LAC 25691 03:29:40.259570 tst handover.py: using RAC 191 03:29:40.382222 tst handover.py: using CellId 25691 03:29:40.505117 tst handover.py: using BVCI 25692 03:29:40.620047 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:40.667567 tst handover.py: using LAC 25692 03:29:40.788486 tst handover.py: using RAC 192 03:29:40.911021 tst handover.py: using CellId 25692 03:29:41.031953 tst handover.py: using BVCI 25693 03:29:41.145789 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:41.156595 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:41.167334 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:41.178341 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:41.189296 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:41.200672 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:41.315854 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:41.434822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:41.916548 run create_hlr_db(pid=20869): Launched 03:29:42.051674 bus /sierra_2: Setting Powered False 03:29:43.117490 run create_hlr_db(pid=20869): Terminated: ok {rc=0} 03:29:43.530628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20871): Launched 03:29:43.840575 run osmo-hlr_10.42.42.2(pid=20872): Launched 03:29:43.958992 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:44.473528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20874): Launched 03:29:44.783187 run osmo-stp_10.42.42.5(pid=20875): Launched 03:29:44.901895 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:45.431618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20877): Launched 03:29:45.739495 run osmo-msc_10.42.42.6(pid=20878): Launched 03:29:45.984923 run osmo-stp_10.42.42.5(pid=20875): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20875)] 03:29:46.199703 run osmo-stp_10.42.42.5(pid=20875): stdout: | (launched: 2022-12-10_03:29:44.726832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:46.425815 run osmo-stp_10.42.42.5(pid=20875): stderr: | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032944900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:46.567596 run osmo-stp_10.42.42.5(pid=20875): stdout: | (launched: 2022-12-10_03:29:44.726832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:46.705262 run osmo-stp_10.42.42.5(pid=20875): stderr: | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032944899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032944900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032944900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:46.867880 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20875): Process ended prematurely: osmo-stp_10.42.42.5(pid=20875) [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20875)] [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 03:29:46.877525 tst handover.py:18: Test FAILED (6.8 sec) 03:29:46.906248 run osmo-hlr_10.42.42.2(pid=20872): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20872)] 03:29:46.958677 run osmo-hlr_10.42.42.2(pid=20872): stdout: | (launched: 2022-12-10_03:29:43.784296) 03:29:47.012390 run osmo-hlr_10.42.42.2(pid=20872): stderr: | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032943963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032943980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032943991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032943991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032943991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:47.088092 run osmo-msc_10.42.42.6(pid=20878): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20878)] 03:29:47.140256 run osmo-msc_10.42.42.6(pid=20878): stdout: | (launched: 2022-12-10_03:29:45.683583) 03:29:47.193366 run osmo-msc_10.42.42.6(pid=20878): stderr: | [0;m[38;5;43m20221210032946089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032946090 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff6f3042c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032946090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032946090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032946090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032946090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032946092 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032946092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032946092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032946092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:47.247042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20871): Terminating (SIGTERM) 03:29:47.291227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20874): Terminating (SIGTERM) 03:29:47.333572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20877): Terminating (SIGTERM) 03:29:47.376164 --- ParallelTerminationStrategy: PID 20871 died... 03:29:47.396346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20871): Terminated: ok {rc=0} 03:29:47.442965 --- ParallelTerminationStrategy: PID 20874 died... 03:29:47.462899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20874): Terminated: ok {rc=0} 03:29:47.509832 --- ParallelTerminationStrategy: PID 20877 died... 03:29:47.529952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20877): Terminated: ok {rc=0} 03:29:47.619242 bus /sierra_3: Setting Powered False 03:29:48.719583 bus /sierra_3: Setting Powered False 03:29:49.836465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:29:51.112170 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:51.118564 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:29:51.179102 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:29:51.205793 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:29:51.259103 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:29:51.320458 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:29:51.347923 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:29:51.896737 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:29:51.902064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:51.913317 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:51.957958 tst handover.py: using LAC 25693 03:29:52.080250 tst handover.py: using RAC 193 03:29:52.202869 tst handover.py: using CellId 25693 03:29:52.323986 tst handover.py: using BVCI 25694 03:29:52.437161 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:52.490762 tst handover.py: using LAC 25694 03:29:52.610938 tst handover.py: using RAC 194 03:29:52.731835 tst handover.py: using CellId 25694 03:29:52.850440 tst handover.py: using BVCI 25695 03:29:52.964389 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:52.975706 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:52.986750 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:52.998120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:53.009564 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:53.020765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:53.141562 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:53.260463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:53.711680 run create_hlr_db(pid=20883): Launched 03:29:53.829086 bus /sierra_2: Setting Powered False 03:29:54.890536 run create_hlr_db(pid=20883): Terminated: ok {rc=0} 03:29:55.311899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20885): Launched 03:29:55.642621 run osmo-hlr_10.42.42.2(pid=20886): Launched 03:29:55.771632 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:56.308466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20888): Launched 03:29:56.638397 run osmo-stp_10.42.42.5(pid=20889): Launched 03:29:56.765419 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:57.334416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20891): Launched 03:29:57.665090 run osmo-msc_10.42.42.6(pid=20892): Launched 03:29:57.842792 run osmo-stp_10.42.42.5(pid=20889): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20889)] 03:29:57.975529 run osmo-stp_10.42.42.5(pid=20889): stdout: | (launched: 2022-12-10_03:29:56.578972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:58.107114 run osmo-stp_10.42.42.5(pid=20889): stderr: | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032956773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:58.236229 run osmo-stp_10.42.42.5(pid=20889): stdout: | (launched: 2022-12-10_03:29:56.578972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:58.359751 run osmo-stp_10.42.42.5(pid=20889): stderr: | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210032956772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210032956773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210032956773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:58.506527 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20889): Process ended prematurely: osmo-stp_10.42.42.5(pid=20889) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20889)] [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 03:29:58.514779 tst handover.py:18: Test FAILED (6.6 sec) 03:29:58.541690 run osmo-hlr_10.42.42.2(pid=20886): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20886)] 03:29:58.590608 run osmo-hlr_10.42.42.2(pid=20886): stdout: | (launched: 2022-12-10_03:29:55.582525) 03:29:58.640833 run osmo-hlr_10.42.42.2(pid=20886): stderr: | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210032955784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210032955800 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210032955810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210032955810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210032955810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:58.710880 run osmo-msc_10.42.42.6(pid=20892): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20892)] 03:29:58.759455 run osmo-msc_10.42.42.6(pid=20892): stdout: | (launched: 2022-12-10_03:29:57.604816) 03:29:58.810252 run osmo-msc_10.42.42.6(pid=20892): stderr: | [0;m[38;5;43m20221210032957879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210032957879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f372ff38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210032957879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210032957879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210032957879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210032957879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210032957881 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210032957881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210032957882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210032957882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:58.860589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20885): Terminating (SIGTERM) 03:29:58.900738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20888): Terminating (SIGTERM) 03:29:58.941101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20891): Terminating (SIGTERM) 03:29:58.981788 --- ParallelTerminationStrategy: PID 20885 died... 03:29:59.001116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20885): Terminated: ok {rc=0} 03:29:59.046129 --- ParallelTerminationStrategy: PID 20888 died... 03:29:59.065043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20888): Terminated: ok {rc=0} 03:29:59.109542 --- ParallelTerminationStrategy: PID 20891 died... 03:29:59.128429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20891): Terminated: ok {rc=0} 03:29:59.214716 bus /sierra_3: Setting Powered False 03:30:00.314708 bus /sierra_3: Setting Powered False 03:30:01.442039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 03:30:02.709019 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:02.714441 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:30:02.761998 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:30:02.788635 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:30:02.841048 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:30:02.887172 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:30:02.914087 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:30:03.465473 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 03:30:03.470720 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:03.481731 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:03.524680 tst handover.py: using LAC 25695 03:30:03.645352 tst handover.py: using RAC 195 03:30:03.765415 tst handover.py: using CellId 25695 03:30:03.895671 tst handover.py: using BVCI 25696 03:30:04.014692 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:04.051069 tst handover.py: using LAC 25696 03:30:04.179664 tst handover.py: using RAC 196 03:30:04.310225 tst handover.py: using CellId 25696 03:30:04.439442 tst handover.py: using BVCI 25697 03:30:04.559083 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:04.570560 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:04.581872 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:04.593267 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:04.604560 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:04.615779 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:04.732174 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:04.848777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:05.299005 run create_hlr_db(pid=20900): Launched 03:30:05.416866 bus /sierra_2: Setting Powered False 03:30:06.478163 run create_hlr_db(pid=20900): Terminated: ok {rc=0} 03:30:06.880576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Launched 03:30:07.188184 run osmo-hlr_10.42.42.2(pid=20903): Launched 03:30:07.306858 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:07.822520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Launched 03:30:08.131846 run osmo-stp_10.42.42.5(pid=20906): Launched 03:30:08.250245 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:08.778381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Launched 03:30:09.089205 run osmo-msc_10.42.42.6(pid=20909): Launched 03:30:09.261930 run osmo-stp_10.42.42.5(pid=20906): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] 03:30:09.395915 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-10_03:30:08.075658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:09.526355 run osmo-stp_10.42.42.5(pid=20906): stderr: | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033008246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033008246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:09.654755 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-10_03:30:08.075658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:09.776566 run osmo-stp_10.42.42.5(pid=20906): stderr: | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033008245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033008246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033008246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033008247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:09.922532 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 03:30:09.930752 tst handover.py:18: Test FAILED (6.5 sec) 03:30:09.957246 run osmo-hlr_10.42.42.2(pid=20903): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20903)] 03:30:10.004820 run osmo-hlr_10.42.42.2(pid=20903): stdout: | (launched: 2022-12-10_03:30:07.131610) 03:30:10.054268 run osmo-hlr_10.42.42.2(pid=20903): stderr: | [0;m[1;31m20221210033007308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033007308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033007308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033007308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033007309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033007309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033007320 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033007328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033007328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033007328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:10.123480 run osmo-msc_10.42.42.6(pid=20909): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20909)] 03:30:10.171328 run osmo-msc_10.42.42.6(pid=20909): stdout: | (launched: 2022-12-10_03:30:09.032841) 03:30:10.221223 run osmo-msc_10.42.42.6(pid=20909): stderr: | [0;m[38;5;43m20221210033009304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033009304 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0f1c91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033009304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033009304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033009304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033009305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033009308 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033009308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033009309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033009309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:10.270973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminating (SIGTERM) 03:30:10.310431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminating (SIGTERM) 03:30:10.350257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Terminating (SIGTERM) 03:30:10.390275 --- ParallelTerminationStrategy: PID 20902 died... 03:30:10.409289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminated: ok {rc=0} 03:30:10.453536 --- ParallelTerminationStrategy: PID 20905 died... 03:30:10.472064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminated: ok {rc=0} 03:30:10.516874 --- ParallelTerminationStrategy: PID 20908 died... 03:30:10.536167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20908): Terminated: ok {rc=0} 03:30:10.623372 bus /sierra_3: Setting Powered False 03:30:11.724033 bus /sierra_3: Setting Powered False 03:30:12.841539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 03:30:14.097890 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:14.103411 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:30:14.163625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:30:14.190957 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:30:14.244140 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:30:14.304651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:30:14.331986 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:30:14.887028 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 03:30:14.892620 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:14.904240 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:14.948856 tst handover.py: using LAC 25697 03:30:15.078596 tst handover.py: using RAC 197 03:30:15.213081 tst handover.py: using CellId 25697 03:30:15.341653 tst handover.py: using BVCI 25698 03:30:15.462630 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:15.510353 tst handover.py: using LAC 25698 03:30:15.638917 tst handover.py: using RAC 198 03:30:15.765882 tst handover.py: using CellId 25698 03:30:15.921299 tst handover.py: using BVCI 25699 03:30:16.048124 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:16.060370 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:16.072562 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:16.085030 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:16.097341 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:16.109596 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:16.228554 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:16.350183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:16.819897 run create_hlr_db(pid=20914): Launched 03:30:16.977712 bus /sierra_2: Setting Powered False 03:30:18.042301 run create_hlr_db(pid=20914): Terminated: ok {rc=0} 03:30:18.455968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20916): Launched 03:30:18.765835 run osmo-hlr_10.42.42.2(pid=20917): Launched 03:30:18.883323 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:19.395709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20919): Launched 03:30:19.702904 run osmo-stp_10.42.42.5(pid=20920): Launched 03:30:19.821619 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:20.350355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20922): Launched 03:30:20.660562 run osmo-msc_10.42.42.6(pid=20923): Launched 03:30:20.833295 run osmo-stp_10.42.42.5(pid=20920): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20920)] 03:30:20.964137 run osmo-stp_10.42.42.5(pid=20920): stdout: | (launched: 2022-12-10_03:30:19.646762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:21.094823 run osmo-stp_10.42.42.5(pid=20920): stderr: | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033019818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:21.223231 run osmo-stp_10.42.42.5(pid=20920): stdout: | (launched: 2022-12-10_03:30:19.646762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:21.344882 run osmo-stp_10.42.42.5(pid=20920): stderr: | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033019818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033019818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033019819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:21.490920 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20920): Process ended prematurely: osmo-stp_10.42.42.5(pid=20920) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20920)] [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 03:30:21.499155 tst handover.py:18: Test FAILED (6.6 sec) 03:30:21.525857 run osmo-hlr_10.42.42.2(pid=20917): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20917)] 03:30:21.573451 run osmo-hlr_10.42.42.2(pid=20917): stdout: | (launched: 2022-12-10_03:30:18.708833) 03:30:21.622706 run osmo-hlr_10.42.42.2(pid=20917): stderr: | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033018888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033018899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033018908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033018908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033018908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:21.691557 run osmo-msc_10.42.42.6(pid=20923): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20923)] 03:30:21.739147 run osmo-msc_10.42.42.6(pid=20923): stdout: | (launched: 2022-12-10_03:30:20.604118) 03:30:21.788385 run osmo-msc_10.42.42.6(pid=20923): stderr: | [0;m[38;5;43m20221210033020878 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033020878 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7410ff9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033020878 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033020878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033020878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033020878 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033020880 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033020881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033020881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033020881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:21.838190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20916): Terminating (SIGTERM) 03:30:21.877821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20919): Terminating (SIGTERM) 03:30:21.917958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20922): Terminating (SIGTERM) 03:30:21.957991 --- ParallelTerminationStrategy: PID 20916 died... 03:30:21.977098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20916): Terminated: ok {rc=0} 03:30:22.021918 --- ParallelTerminationStrategy: PID 20919 died... 03:30:22.040408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20919): Terminated: ok {rc=0} 03:30:22.084841 --- ParallelTerminationStrategy: PID 20922 died... 03:30:22.103916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20922): Terminated: ok {rc=0} 03:30:22.187869 bus /sierra_3: Setting Powered False 03:30:23.286255 bus /sierra_3: Setting Powered False 03:30:24.402547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 03:30:25.671522 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:25.677064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:30:25.735286 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:30:25.761540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:30:25.813278 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:30:25.872691 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:30:25.900181 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:30:26.455525 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 03:30:26.461029 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:26.472463 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:26.517436 tst handover.py: using LAC 25699 03:30:26.646907 tst handover.py: using RAC 199 03:30:26.774404 tst handover.py: using CellId 25699 03:30:26.902825 tst handover.py: using BVCI 25700 03:30:27.022781 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:27.070723 tst handover.py: using LAC 25700 03:30:27.199363 tst handover.py: using RAC 200 03:30:27.327648 tst handover.py: using CellId 25700 03:30:27.456002 tst handover.py: using BVCI 25701 03:30:27.577873 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:27.589451 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:27.600689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:27.612188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:27.623512 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:27.634905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:27.752411 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:27.872791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:28.323281 run create_hlr_db(pid=20928): Launched 03:30:28.441647 bus /sierra_2: Setting Powered False 03:30:29.503585 run create_hlr_db(pid=20928): Terminated: ok {rc=0} 03:30:29.924292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20930): Launched 03:30:30.253808 run osmo-hlr_10.42.42.2(pid=20931): Launched 03:30:30.381834 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:30.937677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20933): Launched 03:30:31.294318 run osmo-stp_10.42.42.5(pid=20934): Launched 03:30:31.614726 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:32.381360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20936): Launched 03:30:32.690262 run osmo-msc_10.42.42.6(pid=20937): Launched 03:30:32.863198 run osmo-stp_10.42.42.5(pid=20934): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20934)] 03:30:32.993560 run osmo-stp_10.42.42.5(pid=20934): stdout: | (launched: 2022-12-10_03:30:31.232496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:33.124718 run osmo-stp_10.42.42.5(pid=20934): stderr: | [0;m[38;5;43m20221210033031561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033031562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033031562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033031565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:33.253246 run osmo-stp_10.42.42.5(pid=20934): stdout: | (launched: 2022-12-10_03:30:31.232496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:33.375614 run osmo-stp_10.42.42.5(pid=20934): stderr: | [0;m[38;5;43m20221210033031561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033031562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033031562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033031565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033031567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:33.522174 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20934): Process ended prematurely: osmo-stp_10.42.42.5(pid=20934) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20934)] [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 03:30:33.530435 tst handover.py:18: Test FAILED (7.1 sec) 03:30:33.557822 run osmo-hlr_10.42.42.2(pid=20931): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20931)] 03:30:33.606446 run osmo-hlr_10.42.42.2(pid=20931): stdout: | (launched: 2022-12-10_03:30:30.194408) 03:30:33.656549 run osmo-hlr_10.42.42.2(pid=20931): stderr: | [0;m[1;31m20221210033030393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033030393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033030394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033030411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033030421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033030421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033030421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:33.726287 run osmo-msc_10.42.42.6(pid=20937): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20937)] 03:30:33.774873 run osmo-msc_10.42.42.6(pid=20937): stdout: | (launched: 2022-12-10_03:30:32.634093) 03:30:33.825178 run osmo-msc_10.42.42.6(pid=20937): stderr: | [0;m[38;5;43m20221210033032909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033032909 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc8a81cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033032909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033032909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033032909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033032909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033032911 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033032911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033032912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033032912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:33.875771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20930): Terminating (SIGTERM) 03:30:33.915926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20933): Terminating (SIGTERM) 03:30:33.956236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20936): Terminating (SIGTERM) 03:30:33.997021 --- ParallelTerminationStrategy: PID 20930 died... 03:30:34.016163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20930): Terminated: ok {rc=0} 03:30:34.062027 --- ParallelTerminationStrategy: PID 20933 died... 03:30:34.080661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20933): Terminated: ok {rc=0} 03:30:34.126159 --- ParallelTerminationStrategy: PID 20936 died... 03:30:34.144796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20936): Terminated: ok {rc=0} 03:30:34.233858 bus /sierra_3: Setting Powered False 03:30:35.334006 bus /sierra_3: Setting Powered False 03:30:36.450296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 03:30:37.719272 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:37.724722 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:30:37.776241 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:30:37.803053 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:30:37.856477 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:30:37.907566 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:30:37.934708 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:30:38.484732 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 03:30:38.489926 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:38.500809 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:38.548368 tst handover.py: using LAC 25701 03:30:38.670710 tst handover.py: using RAC 201 03:30:38.793266 tst handover.py: using CellId 25701 03:30:38.915716 tst handover.py: using BVCI 25702 03:30:39.029859 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:39.064584 tst handover.py: using LAC 25702 03:30:39.185429 tst handover.py: using RAC 202 03:30:39.317007 tst handover.py: using CellId 25702 03:30:39.447112 tst handover.py: using BVCI 25703 03:30:39.569695 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:39.581196 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:39.592358 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:39.604294 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:39.616619 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:39.628587 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:39.750207 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:39.871471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:40.354393 run create_hlr_db(pid=20942): Launched 03:30:40.489426 bus /sierra_2: Setting Powered False 03:30:41.555430 run create_hlr_db(pid=20942): Terminated: ok {rc=0} 03:30:41.985109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Launched 03:30:42.315033 run osmo-hlr_10.42.42.2(pid=20945): Launched 03:30:42.440814 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:42.979221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Launched 03:30:43.310221 run osmo-stp_10.42.42.5(pid=20948): Launched 03:30:43.435967 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:44.002546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20950): Launched 03:30:44.334325 run osmo-msc_10.42.42.6(pid=20951): Launched 03:30:44.518527 run osmo-stp_10.42.42.5(pid=20948): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] 03:30:44.657256 run osmo-stp_10.42.42.5(pid=20948): stdout: | (launched: 2022-12-10_03:30:43.250396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:44.795725 run osmo-stp_10.42.42.5(pid=20948): stderr: | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033043443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:44.933469 run osmo-stp_10.42.42.5(pid=20948): stdout: | (launched: 2022-12-10_03:30:43.250396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:45.063944 run osmo-stp_10.42.42.5(pid=20948): stderr: | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033043442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033043443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033043443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:45.222115 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20948): Process ended prematurely: osmo-stp_10.42.42.5(pid=20948) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 03:30:45.230987 tst handover.py:18: Test FAILED (6.7 sec) 03:30:45.258480 run osmo-hlr_10.42.42.2(pid=20945): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20945)] 03:30:45.308939 run osmo-hlr_10.42.42.2(pid=20945): stdout: | (launched: 2022-12-10_03:30:42.254923) 03:30:45.361096 run osmo-hlr_10.42.42.2(pid=20945): stderr: | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033042455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033042482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033042493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033042493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033042493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:45.432636 run osmo-msc_10.42.42.6(pid=20951): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20951)] 03:30:45.482333 run osmo-msc_10.42.42.6(pid=20951): stdout: | (launched: 2022-12-10_03:30:44.274354) 03:30:45.534028 run osmo-msc_10.42.42.6(pid=20951): stderr: | [0;m[38;5;43m20221210033044597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033044597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7dcc897c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033044597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033044598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033044598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033044598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033044602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033044602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033044602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033044602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:45.585751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Terminating (SIGTERM) 03:30:45.627468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Terminating (SIGTERM) 03:30:45.669201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20950): Terminating (SIGTERM) 03:30:45.711687 --- ParallelTerminationStrategy: PID 20944 died... 03:30:45.731603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20944): Terminated: ok {rc=0} 03:30:45.778194 --- ParallelTerminationStrategy: PID 20947 died... 03:30:45.798033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20947): Terminated: ok {rc=0} 03:30:45.852001 --- ParallelTerminationStrategy: PID 20950 died... 03:30:45.873200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20950): Terminated: ok {rc=0} 03:30:45.964857 bus /sierra_3: Setting Powered False 03:30:47.067064 bus /sierra_3: Setting Powered False 03:30:48.182183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 03:30:49.444937 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:49.450911 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:30:49.516200 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:30:49.543568 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:30:49.596684 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:30:49.665161 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:30:49.692379 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:30:50.238524 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 03:30:50.243726 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:50.254841 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:50.303948 tst handover.py: using LAC 25703 03:30:50.426789 tst handover.py: using RAC 203 03:30:50.548916 tst handover.py: using CellId 25703 03:30:50.671628 tst handover.py: using BVCI 25704 03:30:50.785216 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:50.836902 tst handover.py: using LAC 25704 03:30:50.957462 tst handover.py: using RAC 204 03:30:51.086409 tst handover.py: using CellId 25704 03:30:51.214511 tst handover.py: using BVCI 25705 03:30:51.336075 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:51.347610 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:51.358930 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:51.370332 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:51.381655 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:51.392905 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:51.508348 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:51.629624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:52.111291 run create_hlr_db(pid=20956): Launched 03:30:52.246364 bus /sierra_2: Setting Powered False 03:30:53.311438 run create_hlr_db(pid=20956): Terminated: ok {rc=0} 03:30:53.724239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20958): Launched 03:30:54.033274 run osmo-hlr_10.42.42.2(pid=20959): Launched 03:30:54.151289 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:54.654511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20961): Launched 03:30:54.963565 run osmo-stp_10.42.42.5(pid=20962): Launched 03:30:55.081692 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:55.612221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20964): Launched 03:30:55.921561 run osmo-msc_10.42.42.6(pid=20965): Launched 03:30:56.095095 run osmo-stp_10.42.42.5(pid=20962): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20962)] 03:30:56.226381 run osmo-stp_10.42.42.5(pid=20962): stdout: | (launched: 2022-12-10_03:30:54.907367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:56.357277 run osmo-stp_10.42.42.5(pid=20962): stderr: | [0;m[38;5;43m20221210033055080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033055080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033055081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033055081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:56.486131 run osmo-stp_10.42.42.5(pid=20962): stdout: | (launched: 2022-12-10_03:30:54.907367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:56.608485 run osmo-stp_10.42.42.5(pid=20962): stderr: | [0;m[38;5;43m20221210033055080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033055080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033055081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033055081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033055082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:56.755389 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20962): Process ended prematurely: osmo-stp_10.42.42.5(pid=20962) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20962)] [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 03:30:56.763572 tst handover.py:18: Test FAILED (6.5 sec) 03:30:56.789866 run osmo-hlr_10.42.42.2(pid=20959): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20959)] 03:30:56.837779 run osmo-hlr_10.42.42.2(pid=20959): stdout: | (launched: 2022-12-10_03:30:53.977123) 03:30:56.887144 run osmo-hlr_10.42.42.2(pid=20959): stderr: | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033054156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033054171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033054181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033054181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033054181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:56.955773 run osmo-msc_10.42.42.6(pid=20965): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20965)] 03:30:57.003382 run osmo-msc_10.42.42.6(pid=20965): stdout: | (launched: 2022-12-10_03:30:55.864669) 03:30:57.052930 run osmo-msc_10.42.42.6(pid=20965): stderr: | [0;m[38;5;43m20221210033056137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033056137 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff644a08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033056137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033056137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033056137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033056138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033056139 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033056140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033056140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033056140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:57.102755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20958): Terminating (SIGTERM) 03:30:57.142378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20961): Terminating (SIGTERM) 03:30:57.182226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20964): Terminating (SIGTERM) 03:30:57.222401 --- ParallelTerminationStrategy: PID 20958 died... 03:30:57.241677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20958): Terminated: ok {rc=0} 03:30:57.285828 --- ParallelTerminationStrategy: PID 20961 died... 03:30:57.304435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20961): Terminated: ok {rc=0} 03:30:57.348522 --- ParallelTerminationStrategy: PID 20964 died... 03:30:57.367059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20964): Terminated: ok {rc=0} 03:30:57.452333 bus /sierra_3: Setting Powered False 03:30:58.551823 bus /sierra_3: Setting Powered False 03:30:59.667604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:00.956197 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:00.962302 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:01.029435 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:01.058178 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:01.113060 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:01.187002 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:01.214584 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:01.760512 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:01.767013 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:01.779745 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:01.842960 tst handover.py: using LAC 25705 03:31:01.966338 tst handover.py: using RAC 205 03:31:02.090652 tst handover.py: using CellId 25705 03:31:02.251041 tst handover.py: using BVCI 25706 03:31:02.371714 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:02.419728 tst handover.py: using LAC 25706 03:31:02.547491 tst handover.py: using RAC 206 03:31:02.674434 tst handover.py: using CellId 25706 03:31:02.802370 tst handover.py: using BVCI 25707 03:31:02.923664 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:02.935110 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:02.946522 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:02.957903 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:02.969292 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:02.980878 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:03.097300 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:03.216860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:03.698649 run create_hlr_db(pid=20970): Launched 03:31:03.833941 bus /sierra_2: Setting Powered False 03:31:04.898184 run create_hlr_db(pid=20970): Terminated: ok {rc=0} 03:31:05.311430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20972): Launched 03:31:05.619295 run osmo-hlr_10.42.42.2(pid=20973): Launched 03:31:05.738898 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:06.242164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20975): Launched 03:31:06.550031 run osmo-stp_10.42.42.5(pid=20976): Launched 03:31:06.668108 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:07.196890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20978): Launched 03:31:07.505488 run osmo-msc_10.42.42.6(pid=20979): Launched 03:31:07.678969 run osmo-stp_10.42.42.5(pid=20976): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20976)] 03:31:07.809570 run osmo-stp_10.42.42.5(pid=20976): stdout: | (launched: 2022-12-10_03:31:06.493755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:07.941628 run osmo-stp_10.42.42.5(pid=20976): stderr: | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033106666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:08.069919 run osmo-stp_10.42.42.5(pid=20976): stdout: | (launched: 2022-12-10_03:31:06.493755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:08.192054 run osmo-stp_10.42.42.5(pid=20976): stderr: | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033106666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033106666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033106667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:08.338471 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20976): Process ended prematurely: osmo-stp_10.42.42.5(pid=20976) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20976)] [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 03:31:08.346581 tst handover.py:18: Test FAILED (6.6 sec) 03:31:08.373150 run osmo-hlr_10.42.42.2(pid=20973): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20973)] 03:31:08.420883 run osmo-hlr_10.42.42.2(pid=20973): stdout: | (launched: 2022-12-10_03:31:05.563278) 03:31:08.470041 run osmo-hlr_10.42.42.2(pid=20973): stderr: | [0;m[1;31m20221210033105741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033105741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033105741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033105741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033105742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033105742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033105754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033105765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033105765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033105765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:08.538740 run osmo-msc_10.42.42.6(pid=20979): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20979)] 03:31:08.585780 run osmo-msc_10.42.42.6(pid=20979): stdout: | (launched: 2022-12-10_03:31:07.448869) 03:31:08.635079 run osmo-msc_10.42.42.6(pid=20979): stderr: | [0;m[38;5;43m20221210033107720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033107720 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd4f1ee8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033107720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033107720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033107721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033107721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033107723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033107723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033107723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033107723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:08.684652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20972): Terminating (SIGTERM) 03:31:08.723871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20975): Terminating (SIGTERM) 03:31:08.763276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20978): Terminating (SIGTERM) 03:31:08.803048 --- ParallelTerminationStrategy: PID 20972 died... 03:31:08.822121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20972): Terminated: ok {rc=0} 03:31:08.865988 --- ParallelTerminationStrategy: PID 20975 died... 03:31:08.884332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20975): Terminated: ok {rc=0} 03:31:08.928314 --- ParallelTerminationStrategy: PID 20978 died... 03:31:08.946991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20978): Terminated: ok {rc=0} 03:31:09.032245 bus /sierra_3: Setting Powered False 03:31:10.130282 bus /sierra_3: Setting Powered False 03:31:11.244669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 03:31:12.515051 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:12.520427 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:31:12.571071 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:31:12.597814 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:31:12.654580 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:31:12.705223 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:31:12.731741 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:31:13.278993 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 03:31:13.284201 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:13.294974 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:13.329440 tst handover.py: using LAC 25707 03:31:13.459267 tst handover.py: using RAC 207 03:31:13.590049 tst handover.py: using CellId 25707 03:31:13.717890 tst handover.py: using BVCI 25708 03:31:13.837259 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:13.885485 tst handover.py: using LAC 25708 03:31:14.006276 tst handover.py: using RAC 208 03:31:14.127497 tst handover.py: using CellId 25708 03:31:14.246271 tst handover.py: using BVCI 25709 03:31:14.359946 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:14.370856 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:14.381628 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:14.392458 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:14.403507 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:14.414328 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:14.535469 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:14.651281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:15.101700 run create_hlr_db(pid=20984): Launched 03:31:15.220194 bus /sierra_2: Setting Powered False 03:31:16.281171 run create_hlr_db(pid=20984): Terminated: ok {rc=0} 03:31:16.694054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Launched 03:31:17.024798 run osmo-hlr_10.42.42.2(pid=20987): Launched 03:31:17.266344 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:17.779460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Launched 03:31:18.088932 run osmo-stp_10.42.42.5(pid=20990): Launched 03:31:18.206567 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:18.734020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Launched 03:31:19.043124 run osmo-msc_10.42.42.6(pid=20993): Launched 03:31:19.215462 run osmo-stp_10.42.42.5(pid=20990): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] 03:31:19.345749 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-10_03:31:18.032871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:19.476663 run osmo-stp_10.42.42.5(pid=20990): stderr: | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033118206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:19.605176 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-10_03:31:18.032871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:19.726421 run osmo-stp_10.42.42.5(pid=20990): stderr: | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033118205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033118206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033118206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:19.872239 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 03:31:19.880491 tst handover.py:18: Test FAILED (6.6 sec) 03:31:19.906763 run osmo-hlr_10.42.42.2(pid=20987): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20987)] 03:31:19.954626 run osmo-hlr_10.42.42.2(pid=20987): stdout: | (launched: 2022-12-10_03:31:16.964233) 03:31:20.003964 run osmo-hlr_10.42.42.2(pid=20987): stderr: | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033117278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033117291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033117299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033117299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033117299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:20.073161 run osmo-msc_10.42.42.6(pid=20993): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20993)] 03:31:20.120919 run osmo-msc_10.42.42.6(pid=20993): stdout: | (launched: 2022-12-10_03:31:18.987056) 03:31:20.170212 run osmo-msc_10.42.42.6(pid=20993): stderr: | [0;m[38;5;43m20221210033119259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033119259 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fbcc18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033119259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033119259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033119259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033119259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033119261 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033119262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033119262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033119262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:20.219836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminating (SIGTERM) 03:31:20.259417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminating (SIGTERM) 03:31:20.299177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Terminating (SIGTERM) 03:31:20.339432 --- ParallelTerminationStrategy: PID 20986 died... 03:31:20.358628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminated: ok {rc=0} 03:31:20.403010 --- ParallelTerminationStrategy: PID 20989 died... 03:31:20.421841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminated: ok {rc=0} 03:31:20.466339 --- ParallelTerminationStrategy: PID 20992 died... 03:31:20.484994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Terminated: ok {rc=0} 03:31:20.572314 bus /sierra_3: Setting Powered False 03:31:21.672238 bus /sierra_3: Setting Powered False 03:31:22.788167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:24.042411 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:24.047789 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:24.097731 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:24.124432 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:24.178378 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:24.228470 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:24.255100 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:24.802545 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:24.807675 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:24.818538 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:24.852420 tst handover.py: using LAC 25709 03:31:24.975004 tst handover.py: using RAC 209 03:31:25.098224 tst handover.py: using CellId 25709 03:31:25.228148 tst handover.py: using BVCI 25710 03:31:25.349247 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:25.398565 tst handover.py: using LAC 25710 03:31:25.528518 tst handover.py: using RAC 210 03:31:25.657263 tst handover.py: using CellId 25710 03:31:25.787710 tst handover.py: using BVCI 25711 03:31:25.909060 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:25.920285 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:25.931379 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:25.942507 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:25.953699 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:25.964798 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:26.084872 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:26.205311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:26.686659 run create_hlr_db(pid=20998): Launched 03:31:26.821755 bus /sierra_2: Setting Powered False 03:31:27.887251 run create_hlr_db(pid=20998): Terminated: ok {rc=0} 03:31:28.299621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21000): Launched 03:31:28.607396 run osmo-hlr_10.42.42.2(pid=21001): Launched 03:31:28.725797 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:29.243286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21003): Launched 03:31:29.552888 run osmo-stp_10.42.42.5(pid=21004): Launched 03:31:29.671843 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:30.203339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21006): Launched 03:31:30.512006 run osmo-msc_10.42.42.6(pid=21007): Launched 03:31:30.686153 run osmo-stp_10.42.42.5(pid=21004): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21004)] 03:31:30.817213 run osmo-stp_10.42.42.5(pid=21004): stdout: | (launched: 2022-12-10_03:31:29.496170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:30.964098 run osmo-stp_10.42.42.5(pid=21004): stderr: | [0;m[38;5;43m20221210033129668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033129669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033129669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033129670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:31.096463 run osmo-stp_10.42.42.5(pid=21004): stdout: | (launched: 2022-12-10_03:31:29.496170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:31.222476 run osmo-stp_10.42.42.5(pid=21004): stderr: | [0;m[38;5;43m20221210033129668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033129669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033129669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033129670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033129671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:31.373387 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21004): Process ended prematurely: osmo-stp_10.42.42.5(pid=21004) [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21004)] [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 03:31:31.382672 tst handover.py:18: Test FAILED (6.6 sec) 03:31:31.412416 run osmo-hlr_10.42.42.2(pid=21001): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21001)] 03:31:31.463371 run osmo-hlr_10.42.42.2(pid=21001): stdout: | (launched: 2022-12-10_03:31:28.551264) 03:31:31.516142 run osmo-hlr_10.42.42.2(pid=21001): stderr: | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033128729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033128740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033128749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033128749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033128749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:31.589683 run osmo-msc_10.42.42.6(pid=21007): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21007)] 03:31:31.640655 run osmo-msc_10.42.42.6(pid=21007): stdout: | (launched: 2022-12-10_03:31:30.455846) 03:31:31.694237 run osmo-msc_10.42.42.6(pid=21007): stderr: | [0;m[38;5;43m20221210033130730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033130730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f329af69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033130730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033130730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033130730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033130730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033130732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033130733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033130733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033130733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:31.747438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21000): Terminating (SIGTERM) 03:31:31.790866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21003): Terminating (SIGTERM) 03:31:31.836138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21006): Terminating (SIGTERM) 03:31:31.879393 --- ParallelTerminationStrategy: PID 21000 died... 03:31:31.899481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21000): Terminated: ok {rc=0} 03:31:31.947641 --- ParallelTerminationStrategy: PID 21003 died... 03:31:31.967575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21003): Terminated: ok {rc=0} 03:31:32.015651 --- ParallelTerminationStrategy: PID 21006 died... 03:31:32.035628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21006): Terminated: ok {rc=0} 03:31:32.125835 bus /sierra_3: Setting Powered False 03:31:33.223250 bus /sierra_3: Setting Powered False 03:31:34.340607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2368 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:35.597754 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:35.604267 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:35.668384 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:35.695988 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:35.751017 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:35.815116 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:35.842489 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:36.393041 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2368 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:36.398507 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:36.410068 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:36.458567 tst handover.py: using LAC 25711 03:31:36.589077 tst handover.py: using RAC 211 03:31:36.710638 tst handover.py: using CellId 25711 03:31:36.832153 tst handover.py: using BVCI 25712 03:31:36.946167 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:36.993112 tst handover.py: using LAC 25712 03:31:37.114424 tst handover.py: using RAC 212 03:31:37.236603 tst handover.py: using CellId 25712 03:31:37.356780 tst handover.py: using BVCI 25713 03:31:37.468655 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:37.479543 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:37.490364 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:37.501166 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:37.512925 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:37.523833 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:37.643941 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:37.763648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:38.215471 run create_hlr_db(pid=21012): Launched 03:31:38.333435 bus /sierra_2: Setting Powered False 03:31:39.395422 run create_hlr_db(pid=21012): Terminated: ok {rc=0} 03:31:39.818822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Launched 03:31:40.150462 run osmo-hlr_10.42.42.2(pid=21015): Launched 03:31:40.278406 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:40.818754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Launched 03:31:41.148095 run osmo-stp_10.42.42.5(pid=21018): Launched 03:31:41.273690 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:41.844540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Launched 03:31:42.173644 run osmo-msc_10.42.42.6(pid=21021): Launched 03:31:42.359007 run osmo-stp_10.42.42.5(pid=21018): ERR: Terminated: ERROR {rc=1} [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] 03:31:42.497366 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-10_03:31:41.087992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:42.636463 run osmo-stp_10.42.42.5(pid=21018): stderr: | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033141283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:42.774216 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-10_03:31:41.087992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:42.904743 run osmo-stp_10.42.42.5(pid=21018): stderr: | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210033141282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210033141283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210033141283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:43.061204 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 03:31:43.069969 tst handover.py:18: Test FAILED (6.7 sec) 03:31:43.097414 run osmo-hlr_10.42.42.2(pid=21015): ERR: Terminated: ERROR {rc=237} [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21015)] 03:31:43.147061 run osmo-hlr_10.42.42.2(pid=21015): stdout: | (launched: 2022-12-10_03:31:40.090835) 03:31:43.198583 run osmo-hlr_10.42.42.2(pid=21015): stderr: | [0;m[1;31m20221210033140289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210033140289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210033140289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210033140290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210033140290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210033140290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210033140302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210033140311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210033140311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210033140311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:43.270380 run osmo-msc_10.42.42.6(pid=21021): ERR: Terminated: ERROR {rc=2} [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21021)] 03:31:43.320137 run osmo-msc_10.42.42.6(pid=21021): stdout: | (launched: 2022-12-10_03:31:42.113724) 03:31:43.371754 run osmo-msc_10.42.42.6(pid=21021): stderr: | [0;m[38;5;43m20221210033142439 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210033142439 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0380a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210033142439 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210033142439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210033142440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210033142440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210033142441 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210033142442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210033142442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210033142442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:43.423601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminating (SIGTERM) 03:31:43.465011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminating (SIGTERM) 03:31:43.506919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Terminating (SIGTERM) 03:31:43.548939 --- ParallelTerminationStrategy: PID 21014 died... 03:31:43.568861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminated: ok {rc=0} 03:31:43.615367 --- ParallelTerminationStrategy: PID 21017 died... 03:31:43.634913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminated: ok {rc=0} 03:31:43.680830 --- ParallelTerminationStrategy: PID 21020 died... 03:31:43.700592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Terminated: ok {rc=0} 03:31:43.788221 bus /sierra_3: Setting Powered False 03:31:44.887068 bus /sierra_3: Setting Powered False 03:31:46.003215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2368 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 03:31:47.281868 tst trial-2368: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368/run.2022-12-10_02-07-09/trial-2368.xml -------------------------------------------------------------------------------------------- trial-2368 FAIL -------------------------------------------------------------------------------------------- 03:31:49.222688 tst trial-2368: trial-2368: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=12251): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12251) [trial-2368↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12251)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.6 sec) Error: osmo-stp_10.42.42.5(pid=12261): Process ended prematurely: osmo-stp_10.42.42.5(pid=12261) [trial-2368↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=12270): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12270) [trial-2368↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12270)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12281): Process ended prematurely: osmo-stp_10.42.42.5(pid=12281) [trial-2368↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12281)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12298): Process ended prematurely: osmo-stp_10.42.42.5(pid=12298) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12298)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12309): Process ended prematurely: osmo-stp_10.42.42.5(pid=12309) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12309)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12323): Process ended prematurely: osmo-stp_10.42.42.5(pid=12323) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12323)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12334): Process ended prematurely: osmo-stp_10.42.42.5(pid=12334) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12348): Process ended prematurely: osmo-stp_10.42.42.5(pid=12348) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12348)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2368↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12384): Process ended prematurely: osmo-stp_10.42.42.5(pid=12384) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12384)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12399): Process ended prematurely: osmo-stp_10.42.42.5(pid=12399) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12399)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2368↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12435): Process ended prematurely: osmo-stp_10.42.42.5(pid=12435) [trial-2368↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12435)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12449): Process ended prematurely: osmo-stp_10.42.42.5(pid=12449) [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12460): Process ended prematurely: osmo-stp_10.42.42.5(pid=12460) [trial-2368↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12460)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12479): Process ended prematurely: osmo-stp_10.42.42.5(pid=12479) [trial-2368↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12490): Process ended prematurely: osmo-stp_10.42.42.5(pid=12490) [trial-2368↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=12508): Process ended prematurely: osmo-stp_10.42.42.5(pid=12508) [trial-2368↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12508)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12520): Process ended prematurely: osmo-stp_10.42.42.5(pid=12520) [trial-2368↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12520)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12538): Process ended prematurely: osmo-stp_10.42.42.5(pid=12538) [trial-2368↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12538)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12548): Process ended prematurely: osmo-stp_10.42.42.5(pid=12548) [trial-2368↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12548)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12558): Process ended prematurely: osmo-stp_10.42.42.5(pid=12558) [trial-2368↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12558)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12575): Process ended prematurely: osmo-stp_10.42.42.5(pid=12575) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12575)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12587): Process ended prematurely: osmo-stp_10.42.42.5(pid=12587) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12587)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12626): Process ended prematurely: osmo-stp_10.42.42.5(pid=12626) [trial-2368↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12626)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12648): Process ended prematurely: osmo-stp_10.42.42.5(pid=12648) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12648)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=12660): Process ended prematurely: osmo-stp_10.42.42.5(pid=12660) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12660)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=12678): Process ended prematurely: osmo-stp_10.42.42.5(pid=12678) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12678)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12688): Process ended prematurely: osmo-stp_10.42.42.5(pid=12688) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12688)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12698): Process ended prematurely: osmo-stp_10.42.42.5(pid=12698) [trial-2368↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12698)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12718): Process ended prematurely: osmo-stp_10.42.42.5(pid=12718) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=12730): Process ended prematurely: osmo-stp_10.42.42.5(pid=12730) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12730)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=12748): Process ended prematurely: osmo-stp_10.42.42.5(pid=12748) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12748)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12758): Process ended prematurely: osmo-stp_10.42.42.5(pid=12758) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12758)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2368↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12785): Process ended prematurely: osmo-stp_10.42.42.5(pid=12785) [trial-2368↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12785)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12798): Process ended prematurely: osmo-stp_10.42.42.5(pid=12798) [trial-2368↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12798)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=12810): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12810) [trial-2368↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12810)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12820): Process ended prematurely: osmo-stp_10.42.42.5(pid=12820) [trial-2368↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12831) [trial-2368↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12831)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12841): Process ended prematurely: osmo-stp_10.42.42.5(pid=12841) [trial-2368↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12841)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12855): Process ended prematurely: osmo-stp_10.42.42.5(pid=12855) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12855)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12866): Process ended prematurely: osmo-stp_10.42.42.5(pid=12866) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12866)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12880): Process ended prematurely: osmo-stp_10.42.42.5(pid=12880) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12880)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12891): Process ended prematurely: osmo-stp_10.42.42.5(pid=12891) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12905): Process ended prematurely: osmo-stp_10.42.42.5(pid=12905) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12905)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12920): Process ended prematurely: osmo-stp_10.42.42.5(pid=12920) [trial-2368↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12934): Process ended prematurely: osmo-stp_10.42.42.5(pid=12934) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12945): Process ended prematurely: osmo-stp_10.42.42.5(pid=12945) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12959): Process ended prematurely: osmo-stp_10.42.42.5(pid=12959) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12959)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12970): Process ended prematurely: osmo-stp_10.42.42.5(pid=12970) [trial-2368↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12970)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12984): Process ended prematurely: osmo-stp_10.42.42.5(pid=12984) [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12984)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12999): Process ended prematurely: osmo-stp_10.42.42.5(pid=12999) [trial-2368↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12999)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13013): Process ended prematurely: osmo-stp_10.42.42.5(pid=13013) [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13013)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13024): Process ended prematurely: osmo-stp_10.42.42.5(pid=13024) [trial-2368↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13024)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13039): Process ended prematurely: osmo-stp_10.42.42.5(pid=13039) [trial-2368↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13039)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13050): Process ended prematurely: osmo-stp_10.42.42.5(pid=13050) [trial-2368↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13068): Process ended prematurely: osmo-stp_10.42.42.5(pid=13068) [trial-2368↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13068)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13080): Process ended prematurely: osmo-stp_10.42.42.5(pid=13080) [trial-2368↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13098): Process ended prematurely: osmo-stp_10.42.42.5(pid=13098) [trial-2368↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13098)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13108): Process ended prematurely: osmo-stp_10.42.42.5(pid=13108) [trial-2368↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13108)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13118): Process ended prematurely: osmo-stp_10.42.42.5(pid=13118) [trial-2368↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13118)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13135): Process ended prematurely: osmo-stp_10.42.42.5(pid=13135) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13147): Process ended prematurely: osmo-stp_10.42.42.5(pid=13147) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13147)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=13165): Process ended prematurely: osmo-stp_10.42.42.5(pid=13165) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13165)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13176): Process ended prematurely: osmo-stp_10.42.42.5(pid=13176) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13176)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13186): Process ended prematurely: osmo-stp_10.42.42.5(pid=13186) [trial-2368↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13204): Process ended prematurely: osmo-stp_10.42.42.5(pid=13204) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13204)] FAIL: iperf3.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13486): Process ended prematurely: osmo-stp_10.42.42.5(pid=13486) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=13506): Process ended prematurely: osmo-stp_10.42.42.5(pid=13506) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13506)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13516): Process ended prematurely: osmo-stp_10.42.42.5(pid=13516) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13516)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13526): Process ended prematurely: osmo-stp_10.42.42.5(pid=13526) [trial-2368↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13526)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13544): Process ended prematurely: osmo-stp_10.42.42.5(pid=13544) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13544)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13556): Process ended prematurely: osmo-stp_10.42.42.5(pid=13556) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13574): Process ended prematurely: osmo-stp_10.42.42.5(pid=13574) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13574)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13584): Process ended prematurely: osmo-stp_10.42.42.5(pid=13584) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13584)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13594): Process ended prematurely: osmo-stp_10.42.42.5(pid=13594) [trial-2368↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13594)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13610): Process ended prematurely: osmo-stp_10.42.42.5(pid=13610) [trial-2368↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13610)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13624): Process ended prematurely: osmo-stp_10.42.42.5(pid=13624) [trial-2368↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13632): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13632) [trial-2368↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13632)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13642): Process ended prematurely: osmo-stp_10.42.42.5(pid=13642) [trial-2368↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13642)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13652): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13652) [trial-2368↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13652)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2368↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13677): Process ended prematurely: osmo-stp_10.42.42.5(pid=13677) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13677)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13688): Process ended prematurely: osmo-stp_10.42.42.5(pid=13688) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13688)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13702): Process ended prematurely: osmo-stp_10.42.42.5(pid=13702) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13702)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13713): Process ended prematurely: osmo-stp_10.42.42.5(pid=13713) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13713)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13727): Process ended prematurely: osmo-stp_10.42.42.5(pid=13727) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13738): Process ended prematurely: osmo-stp_10.42.42.5(pid=13738) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13738)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13752): Process ended prematurely: osmo-stp_10.42.42.5(pid=13752) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13752)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13763): Process ended prematurely: osmo-stp_10.42.42.5(pid=13763) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13763)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13777): Process ended prematurely: osmo-stp_10.42.42.5(pid=13777) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13777)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13790): Process ended prematurely: osmo-stp_10.42.42.5(pid=13790) [trial-2368↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13790)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13804): Process ended prematurely: osmo-stp_10.42.42.5(pid=13804) [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13804)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13815): Process ended prematurely: osmo-stp_10.42.42.5(pid=13815) [trial-2368↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13815)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13830): Process ended prematurely: osmo-stp_10.42.42.5(pid=13830) [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13841): Process ended prematurely: osmo-stp_10.42.42.5(pid=13841) [trial-2368↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13841)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13856): Process ended prematurely: osmo-stp_10.42.42.5(pid=13856) [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13856)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13867): Process ended prematurely: osmo-stp_10.42.42.5(pid=13867) [trial-2368↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13867)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13882): Process ended prematurely: osmo-stp_10.42.42.5(pid=13882) [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2368↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13909): Process ended prematurely: osmo-stp_10.42.42.5(pid=13909) [trial-2368↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13909)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13920): Process ended prematurely: osmo-stp_10.42.42.5(pid=13920) [trial-2368↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13920)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13938): Process ended prematurely: osmo-stp_10.42.42.5(pid=13938) [trial-2368↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13938)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13950): Process ended prematurely: osmo-stp_10.42.42.5(pid=13950) [trial-2368↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13950)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13971): Process ended prematurely: osmo-stp_10.42.42.5(pid=13971) [trial-2368↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13971)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13981): Process ended prematurely: osmo-stp_10.42.42.5(pid=13981) [trial-2368↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13981)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13991): Process ended prematurely: osmo-stp_10.42.42.5(pid=13991) [trial-2368↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13991)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14011): Process ended prematurely: osmo-stp_10.42.42.5(pid=14011) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14011)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14023): Process ended prematurely: osmo-stp_10.42.42.5(pid=14023) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14023)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=14041): Process ended prematurely: osmo-stp_10.42.42.5(pid=14041) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14041)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14051): Process ended prematurely: osmo-stp_10.42.42.5(pid=14051) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14061): Process ended prematurely: osmo-stp_10.42.42.5(pid=14061) [trial-2368↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14061)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14078): Process ended prematurely: osmo-stp_10.42.42.5(pid=14078) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14078)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14090): Process ended prematurely: osmo-stp_10.42.42.5(pid=14090) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14090)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14108): Process ended prematurely: osmo-stp_10.42.42.5(pid=14108) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14108)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14118): Process ended prematurely: osmo-stp_10.42.42.5(pid=14118) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14128): Process ended prematurely: osmo-stp_10.42.42.5(pid=14128) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14128)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14149): Process ended prematurely: osmo-stp_10.42.42.5(pid=14149) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14163): Process ended prematurely: osmo-stp_10.42.42.5(pid=14163) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14182): Process ended prematurely: osmo-stp_10.42.42.5(pid=14182) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14182)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14203): Process ended prematurely: osmo-stp_10.42.42.5(pid=14203) [trial-2368↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=14220): Process ended prematurely: osmo-stp_10.42.42.5(pid=14220) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14232): Process ended prematurely: osmo-stp_10.42.42.5(pid=14232) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14232)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14250): Process ended prematurely: osmo-stp_10.42.42.5(pid=14250) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14250)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14260): Process ended prematurely: osmo-stp_10.42.42.5(pid=14260) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14260)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14270): Process ended prematurely: osmo-stp_10.42.42.5(pid=14270) [trial-2368↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14297): Process ended prematurely: osmo-stp_10.42.42.5(pid=14297) [trial-2368↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14297)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14308): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14308) [trial-2368↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14308)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14320): Process ended prematurely: osmo-stp_10.42.42.5(pid=14320) [trial-2368↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14320)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14329) [trial-2368↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14329)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14339): Process ended prematurely: osmo-stp_10.42.42.5(pid=14339) [trial-2368↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14339)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14353): Process ended prematurely: osmo-stp_10.42.42.5(pid=14353) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14353)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14364): Process ended prematurely: osmo-stp_10.42.42.5(pid=14364) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14364)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14378): Process ended prematurely: osmo-stp_10.42.42.5(pid=14378) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14378)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14389): Process ended prematurely: osmo-stp_10.42.42.5(pid=14389) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14389)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14404): Process ended prematurely: osmo-stp_10.42.42.5(pid=14404) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14404)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14415): Process ended prematurely: osmo-stp_10.42.42.5(pid=14415) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14429): Process ended prematurely: osmo-stp_10.42.42.5(pid=14429) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14429)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14440): Process ended prematurely: osmo-stp_10.42.42.5(pid=14440) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14440)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14454): Process ended prematurely: osmo-stp_10.42.42.5(pid=14454) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14454)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14465): Process ended prematurely: osmo-stp_10.42.42.5(pid=14465) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14465)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14479): Process ended prematurely: osmo-stp_10.42.42.5(pid=14479) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14479)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14491): Process ended prematurely: osmo-stp_10.42.42.5(pid=14491) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14491)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14505): Process ended prematurely: osmo-stp_10.42.42.5(pid=14505) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14505)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14516): Process ended prematurely: osmo-stp_10.42.42.5(pid=14516) [trial-2368↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14516)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14531): Process ended prematurely: osmo-stp_10.42.42.5(pid=14531) [trial-2368↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14531)] FAIL: emergency_preemptive_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14813): Process ended prematurely: osmo-stp_10.42.42.5(pid=14813) [trial-2368↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14813)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14834): Process ended prematurely: osmo-stp_10.42.42.5(pid=14834) [trial-2368↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14834)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14846): Process ended prematurely: osmo-stp_10.42.42.5(pid=14846) [trial-2368↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14846)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14864): Process ended prematurely: osmo-stp_10.42.42.5(pid=14864) [trial-2368↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14864)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14874): Process ended prematurely: osmo-stp_10.42.42.5(pid=14874) [trial-2368↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14874)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14884): Process ended prematurely: osmo-stp_10.42.42.5(pid=14884) [trial-2368↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14884)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=14901): Process ended prematurely: osmo-stp_10.42.42.5(pid=14901) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14901)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14913): Process ended prematurely: osmo-stp_10.42.42.5(pid=14913) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14934): Process ended prematurely: osmo-stp_10.42.42.5(pid=14934) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14934)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14954): Process ended prematurely: osmo-stp_10.42.42.5(pid=14954) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14954)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14971): Process ended prematurely: osmo-stp_10.42.42.5(pid=14971) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14983): Process ended prematurely: osmo-stp_10.42.42.5(pid=14983) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14983)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15001): Process ended prematurely: osmo-stp_10.42.42.5(pid=15001) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15001)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15011): Process ended prematurely: osmo-stp_10.42.42.5(pid=15011) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15021): Process ended prematurely: osmo-stp_10.42.42.5(pid=15021) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15021)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=15039): Process ended prematurely: osmo-stp_10.42.42.5(pid=15039) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15051): Process ended prematurely: osmo-stp_10.42.42.5(pid=15051) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15072): Process ended prematurely: osmo-stp_10.42.42.5(pid=15072) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15072)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15082): Process ended prematurely: osmo-stp_10.42.42.5(pid=15082) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15082)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2368↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15105): Process ended prematurely: osmo-stp_10.42.42.5(pid=15105) [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15105)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15118): Process ended prematurely: osmo-stp_10.42.42.5(pid=15118) [trial-2368↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15118)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15127) [trial-2368↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15127)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15137): Process ended prematurely: osmo-stp_10.42.42.5(pid=15137) [trial-2368↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15137)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=15146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15146) [trial-2368↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15146)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15158): Process ended prematurely: osmo-stp_10.42.42.5(pid=15158) [trial-2368↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15158)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15172): Process ended prematurely: osmo-stp_10.42.42.5(pid=15172) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15172)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15183): Process ended prematurely: osmo-stp_10.42.42.5(pid=15183) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15183)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15198): Process ended prematurely: osmo-stp_10.42.42.5(pid=15198) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15198)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15209): Process ended prematurely: osmo-stp_10.42.42.5(pid=15209) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15209)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15223): Process ended prematurely: osmo-stp_10.42.42.5(pid=15223) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15223)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15234): Process ended prematurely: osmo-stp_10.42.42.5(pid=15234) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15234)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15248): Process ended prematurely: osmo-stp_10.42.42.5(pid=15248) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15248)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15260): Process ended prematurely: osmo-stp_10.42.42.5(pid=15260) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15274): Process ended prematurely: osmo-stp_10.42.42.5(pid=15274) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15274)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15288): Process ended prematurely: osmo-stp_10.42.42.5(pid=15288) [trial-2368↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15288)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15302): Process ended prematurely: osmo-stp_10.42.42.5(pid=15302) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15302)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15313): Process ended prematurely: osmo-stp_10.42.42.5(pid=15313) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15313)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15327): Process ended prematurely: osmo-stp_10.42.42.5(pid=15327) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15338): Process ended prematurely: osmo-stp_10.42.42.5(pid=15338) [trial-2368↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15338)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15352): Process ended prematurely: osmo-stp_10.42.42.5(pid=15352) [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15352)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15363): Process ended prematurely: osmo-stp_10.42.42.5(pid=15363) [trial-2368↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15363)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15377): Process ended prematurely: osmo-stp_10.42.42.5(pid=15377) [trial-2368↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15377)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15388): Process ended prematurely: osmo-stp_10.42.42.5(pid=15388) [trial-2368↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15388)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=15407): Process ended prematurely: osmo-stp_10.42.42.5(pid=15407) [trial-2368↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15407)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=15419): Process ended prematurely: osmo-stp_10.42.42.5(pid=15419) [trial-2368↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=15437): Process ended prematurely: osmo-stp_10.42.42.5(pid=15437) [trial-2368↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15437)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2368↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2368↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=15476): Process ended prematurely: osmo-stp_10.42.42.5(pid=15476) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15476)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=15506): Process ended prematurely: osmo-stp_10.42.42.5(pid=15506) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15506)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15516): Process ended prematurely: osmo-stp_10.42.42.5(pid=15516) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15526): Process ended prematurely: osmo-stp_10.42.42.5(pid=15526) [trial-2368↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15543): Process ended prematurely: osmo-stp_10.42.42.5(pid=15543) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=15556): Process ended prematurely: osmo-stp_10.42.42.5(pid=15556) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15556)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15574): Process ended prematurely: osmo-stp_10.42.42.5(pid=15574) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15574)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15584): Process ended prematurely: osmo-stp_10.42.42.5(pid=15584) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15584)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15594): Process ended prematurely: osmo-stp_10.42.42.5(pid=15594) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15594)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15611): Process ended prematurely: osmo-stp_10.42.42.5(pid=15611) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15611)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15626): Process ended prematurely: osmo-stp_10.42.42.5(pid=15626) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15626)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=15644): Process ended prematurely: osmo-stp_10.42.42.5(pid=15644) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15644)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15656): Process ended prematurely: osmo-stp_10.42.42.5(pid=15656) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15656)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2368↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15683): Process ended prematurely: osmo-stp_10.42.42.5(pid=15683) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15695): Process ended prematurely: osmo-stp_10.42.42.5(pid=15695) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15695)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15713): Process ended prematurely: osmo-stp_10.42.42.5(pid=15713) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15713)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15723): Process ended prematurely: osmo-stp_10.42.42.5(pid=15723) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15723)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15733): Process ended prematurely: osmo-stp_10.42.42.5(pid=15733) [trial-2368↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15733)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15747): Process ended prematurely: osmo-stp_10.42.42.5(pid=15747) [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15747)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15761): Process ended prematurely: osmo-stp_10.42.42.5(pid=15761) [trial-2368↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15761)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15770) [trial-2368↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15770)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2368↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=15790): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15790) [trial-2368↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15790)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15804): Process ended prematurely: osmo-stp_10.42.42.5(pid=15804) [trial-2368↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15804)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15818): Process ended prematurely: osmo-stp_10.42.42.5(pid=15818) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15818)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15829): Process ended prematurely: osmo-stp_10.42.42.5(pid=15829) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15829)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16146): Process ended prematurely: osmo-stp_10.42.42.5(pid=16146) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16146)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16158): Process ended prematurely: osmo-stp_10.42.42.5(pid=16158) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16158)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16172): Process ended prematurely: osmo-stp_10.42.42.5(pid=16172) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16172)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16183): Process ended prematurely: osmo-stp_10.42.42.5(pid=16183) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16198): Process ended prematurely: osmo-stp_10.42.42.5(pid=16198) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16198)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16209): Process ended prematurely: osmo-stp_10.42.42.5(pid=16209) [trial-2368↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16209)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16223): Process ended prematurely: osmo-stp_10.42.42.5(pid=16223) [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16223)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16234): Process ended prematurely: osmo-stp_10.42.42.5(pid=16234) [trial-2368↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16234)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16248): Process ended prematurely: osmo-stp_10.42.42.5(pid=16248) [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16248)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16262): Process ended prematurely: osmo-stp_10.42.42.5(pid=16262) [trial-2368↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16262)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16276): Process ended prematurely: osmo-stp_10.42.42.5(pid=16276) [trial-2368↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16276)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2368↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16306): Process ended prematurely: osmo-stp_10.42.42.5(pid=16306) [trial-2368↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16306)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16318): Process ended prematurely: osmo-stp_10.42.42.5(pid=16318) [trial-2368↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16318)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=16336): Process ended prematurely: osmo-stp_10.42.42.5(pid=16336) [trial-2368↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16336)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16346): Process ended prematurely: osmo-stp_10.42.42.5(pid=16346) [trial-2368↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16356): Process ended prematurely: osmo-stp_10.42.42.5(pid=16356) [trial-2368↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16356)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=16375): Process ended prematurely: osmo-stp_10.42.42.5(pid=16375) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16375)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16405): Process ended prematurely: osmo-stp_10.42.42.5(pid=16405) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16405)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16415): Process ended prematurely: osmo-stp_10.42.42.5(pid=16415) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16415)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16427): Process ended prematurely: osmo-stp_10.42.42.5(pid=16427) [trial-2368↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16427)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16445): Process ended prematurely: osmo-stp_10.42.42.5(pid=16445) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16445)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16457): Process ended prematurely: osmo-stp_10.42.42.5(pid=16457) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16457)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=16475): Process ended prematurely: osmo-stp_10.42.42.5(pid=16475) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16485): Process ended prematurely: osmo-stp_10.42.42.5(pid=16485) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16485)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16495): Process ended prematurely: osmo-stp_10.42.42.5(pid=16495) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16495)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16512): Process ended prematurely: osmo-stp_10.42.42.5(pid=16512) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16512)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16524): Process ended prematurely: osmo-stp_10.42.42.5(pid=16524) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16524)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=16542): Process ended prematurely: osmo-stp_10.42.42.5(pid=16542) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16542)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16553): Process ended prematurely: osmo-stp_10.42.42.5(pid=16553) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16553)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16563): Process ended prematurely: osmo-stp_10.42.42.5(pid=16563) [trial-2368↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16563)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16576): Process ended prematurely: osmo-stp_10.42.42.5(pid=16576) [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16591): Process ended prematurely: osmo-stp_10.42.42.5(pid=16591) [trial-2368↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16591)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=16647): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16647) [trial-2368↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16647)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17012): Process ended prematurely: osmo-stp_10.42.42.5(pid=17012) [trial-2368↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=17198): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17198) [trial-2368↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17198)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17209): Process ended prematurely: osmo-stp_10.42.42.5(pid=17209) [trial-2368↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17223): Process ended prematurely: osmo-stp_10.42.42.5(pid=17223) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17234): Process ended prematurely: osmo-stp_10.42.42.5(pid=17234) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17234)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17248): Process ended prematurely: osmo-stp_10.42.42.5(pid=17248) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17248)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17259): Process ended prematurely: osmo-stp_10.42.42.5(pid=17259) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17259)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17274): Process ended prematurely: osmo-stp_10.42.42.5(pid=17274) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17274)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17285): Process ended prematurely: osmo-stp_10.42.42.5(pid=17285) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17299): Process ended prematurely: osmo-stp_10.42.42.5(pid=17299) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17299)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17310): Process ended prematurely: osmo-stp_10.42.42.5(pid=17310) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17310)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17324): Process ended prematurely: osmo-stp_10.42.42.5(pid=17324) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17335): Process ended prematurely: osmo-stp_10.42.42.5(pid=17335) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17335)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17350): Process ended prematurely: osmo-stp_10.42.42.5(pid=17350) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17350)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17362): Process ended prematurely: osmo-stp_10.42.42.5(pid=17362) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17362)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17376): Process ended prematurely: osmo-stp_10.42.42.5(pid=17376) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17376)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17389): Process ended prematurely: osmo-stp_10.42.42.5(pid=17389) [trial-2368↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17403): Process ended prematurely: osmo-stp_10.42.42.5(pid=17403) [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17414): Process ended prematurely: osmo-stp_10.42.42.5(pid=17414) [trial-2368↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17414)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2368↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17445): Process ended prematurely: osmo-stp_10.42.42.5(pid=17445) [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17445)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17463): Process ended prematurely: osmo-stp_10.42.42.5(pid=17463) [trial-2368↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17463)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17473): Process ended prematurely: osmo-stp_10.42.42.5(pid=17473) [trial-2368↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17473)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17484): Process ended prematurely: osmo-stp_10.42.42.5(pid=17484) [trial-2368↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17484)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17501): Process ended prematurely: osmo-stp_10.42.42.5(pid=17501) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17501)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17513): Process ended prematurely: osmo-stp_10.42.42.5(pid=17513) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17513)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=17534): Process ended prematurely: osmo-stp_10.42.42.5(pid=17534) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17534)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17544): Process ended prematurely: osmo-stp_10.42.42.5(pid=17544) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17554): Process ended prematurely: osmo-stp_10.42.42.5(pid=17554) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17554)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=17571): Process ended prematurely: osmo-stp_10.42.42.5(pid=17571) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17571)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17584): Process ended prematurely: osmo-stp_10.42.42.5(pid=17584) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17584)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17612): Process ended prematurely: osmo-stp_10.42.42.5(pid=17612) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17612)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17622): Process ended prematurely: osmo-stp_10.42.42.5(pid=17622) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=17640): Process ended prematurely: osmo-stp_10.42.42.5(pid=17640) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17640)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17652): Process ended prematurely: osmo-stp_10.42.42.5(pid=17652) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17670): Process ended prematurely: osmo-stp_10.42.42.5(pid=17670) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17670)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17681): Process ended prematurely: osmo-stp_10.42.42.5(pid=17681) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17681)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17691): Process ended prematurely: osmo-stp_10.42.42.5(pid=17691) [trial-2368↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17691)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17705): Process ended prematurely: osmo-stp_10.42.42.5(pid=17705) [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17705)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17718): Process ended prematurely: osmo-stp_10.42.42.5(pid=17718) [trial-2368↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17718)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17726) [trial-2368↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17726)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=17736): Process ended prematurely: osmo-stp_10.42.42.5(pid=17736) [trial-2368↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17736)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=17745): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17745) [trial-2368↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17745)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2368↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18040): Process ended prematurely: osmo-stp_10.42.42.5(pid=18040) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18040)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18053): Process ended prematurely: osmo-stp_10.42.42.5(pid=18053) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18053)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18067): Process ended prematurely: osmo-stp_10.42.42.5(pid=18067) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18067)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18078): Process ended prematurely: osmo-stp_10.42.42.5(pid=18078) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18078)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18093): Process ended prematurely: osmo-stp_10.42.42.5(pid=18093) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18093)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18104): Process ended prematurely: osmo-stp_10.42.42.5(pid=18104) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18119): Process ended prematurely: osmo-stp_10.42.42.5(pid=18119) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18119)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18131): Process ended prematurely: osmo-stp_10.42.42.5(pid=18131) [trial-2368↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18131)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18145): Process ended prematurely: osmo-stp_10.42.42.5(pid=18145) [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18145)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18159): Process ended prematurely: osmo-stp_10.42.42.5(pid=18159) [trial-2368↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18159)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18173): Process ended prematurely: osmo-stp_10.42.42.5(pid=18173) [trial-2368↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18173)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18184): Process ended prematurely: osmo-stp_10.42.42.5(pid=18184) [trial-2368↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18203): Process ended prematurely: osmo-stp_10.42.42.5(pid=18203) [trial-2368↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18203)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18215): Process ended prematurely: osmo-stp_10.42.42.5(pid=18215) [trial-2368↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=18233): Process ended prematurely: osmo-stp_10.42.42.5(pid=18233) [trial-2368↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18233)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18243): Process ended prematurely: osmo-stp_10.42.42.5(pid=18243) [trial-2368↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18243)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18253): Process ended prematurely: osmo-stp_10.42.42.5(pid=18253) [trial-2368↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18253)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18282): Process ended prematurely: osmo-stp_10.42.42.5(pid=18282) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18282)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18300): Process ended prematurely: osmo-stp_10.42.42.5(pid=18300) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18300)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18310): Process ended prematurely: osmo-stp_10.42.42.5(pid=18310) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18310)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18320): Process ended prematurely: osmo-stp_10.42.42.5(pid=18320) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18320)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18337): Process ended prematurely: osmo-stp_10.42.42.5(pid=18337) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18337)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18349): Process ended prematurely: osmo-stp_10.42.42.5(pid=18349) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18349)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18367): Process ended prematurely: osmo-stp_10.42.42.5(pid=18367) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18377): Process ended prematurely: osmo-stp_10.42.42.5(pid=18377) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18377)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18387): Process ended prematurely: osmo-stp_10.42.42.5(pid=18387) [trial-2368↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18387)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18401): Process ended prematurely: osmo-stp_10.42.42.5(pid=18401) [trial-2368↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18401)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18414): Process ended prematurely: osmo-stp_10.42.42.5(pid=18414) [trial-2368↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18414)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18424) [trial-2368↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18424)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18434): Process ended prematurely: osmo-stp_10.42.42.5(pid=18434) [trial-2368↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18434)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18448): Process ended prematurely: osmo-stp_10.42.42.5(pid=18448) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18448)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18459): Process ended prematurely: osmo-stp_10.42.42.5(pid=18459) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18459)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18473): Process ended prematurely: osmo-stp_10.42.42.5(pid=18473) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18473)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18485): Process ended prematurely: osmo-stp_10.42.42.5(pid=18485) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18485)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18502): Process ended prematurely: osmo-stp_10.42.42.5(pid=18502) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18502)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18513): Process ended prematurely: osmo-stp_10.42.42.5(pid=18513) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18513)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18527): Process ended prematurely: osmo-stp_10.42.42.5(pid=18527) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18527)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18538): Process ended prematurely: osmo-stp_10.42.42.5(pid=18538) [trial-2368↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18538)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18552): Process ended prematurely: osmo-stp_10.42.42.5(pid=18552) [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18552)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18563): Process ended prematurely: osmo-stp_10.42.42.5(pid=18563) [trial-2368↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18563)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18577): Process ended prematurely: osmo-stp_10.42.42.5(pid=18577) [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18577)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18588): Process ended prematurely: osmo-stp_10.42.42.5(pid=18588) [trial-2368↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18588)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18602): Process ended prematurely: osmo-stp_10.42.42.5(pid=18602) [trial-2368↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18602)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18613): Process ended prematurely: osmo-stp_10.42.42.5(pid=18613) [trial-2368↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18613)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18632): Process ended prematurely: osmo-stp_10.42.42.5(pid=18632) [trial-2368↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18632)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18647): Process ended prematurely: osmo-stp_10.42.42.5(pid=18647) [trial-2368↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=18665): Process ended prematurely: osmo-stp_10.42.42.5(pid=18665) [trial-2368↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18665)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18681): Process ended prematurely: osmo-stp_10.42.42.5(pid=18681) [trial-2368↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18694): Process ended prematurely: osmo-stp_10.42.42.5(pid=18694) [trial-2368↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18694)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18717): Process ended prematurely: osmo-stp_10.42.42.5(pid=18717) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18717)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18730): Process ended prematurely: osmo-stp_10.42.42.5(pid=18730) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18730)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=18748): Process ended prematurely: osmo-stp_10.42.42.5(pid=18748) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18748)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18774): Process ended prematurely: osmo-stp_10.42.42.5(pid=18774) [trial-2368↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=18791): Process ended prematurely: osmo-stp_10.42.42.5(pid=18791) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18791)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18803): Process ended prematurely: osmo-stp_10.42.42.5(pid=18803) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18803)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18821): Process ended prematurely: osmo-stp_10.42.42.5(pid=18821) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18821)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18831): Process ended prematurely: osmo-stp_10.42.42.5(pid=18831) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18831)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18841): Process ended prematurely: osmo-stp_10.42.42.5(pid=18841) [trial-2368↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18841)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18858): Process ended prematurely: osmo-stp_10.42.42.5(pid=18858) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18858)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18881): Process ended prematurely: osmo-stp_10.42.42.5(pid=18881) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18881)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19427): Process ended prematurely: osmo-stp_10.42.42.5(pid=19427) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19427)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19438): Process ended prematurely: osmo-stp_10.42.42.5(pid=19438) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19438)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19448): Process ended prematurely: osmo-stp_10.42.42.5(pid=19448) [trial-2368↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19448)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19461): Process ended prematurely: osmo-stp_10.42.42.5(pid=19461) [trial-2368↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19461)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=19471): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19471) [trial-2368↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19471)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=19473): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19473) [trial-2368↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19473)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=19475): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19475) [trial-2368↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19475)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=19477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19477) [trial-2368↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19477)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=19486): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19486) [trial-2368↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19486)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=19497): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19497) [trial-2368↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19497)] FAIL: esme_ms_sms_storeforward.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19509): Process ended prematurely: osmo-stp_10.42.42.5(pid=19509) [trial-2368↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19509)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19520): Process ended prematurely: osmo-stp_10.42.42.5(pid=19520) [trial-2368↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19534): Process ended prematurely: osmo-stp_10.42.42.5(pid=19534) [trial-2368↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19534)] FAIL: register_a5_0_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19545): Process ended prematurely: osmo-stp_10.42.42.5(pid=19545) [trial-2368↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19545)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19556): Process ended prematurely: osmo-stp_10.42.42.5(pid=19556) [trial-2368↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19556)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19567): Process ended prematurely: osmo-stp_10.42.42.5(pid=19567) [trial-2368↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19567)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=19588): Process ended prematurely: srsepc(pid=19588) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19588)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=19604): Process ended prematurely: srsepc(pid=19604) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19604)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=19900): Process ended prematurely: srsepc(pid=19900) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19900)] FAIL: iperf3_ul.py (19.8 sec) Error: srsepc(pid=19918): Process ended prematurely: srsepc(pid=19918) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19918)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=19934): Process ended prematurely: srsepc(pid=19934) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19934)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=19950): Process ended prematurely: srsepc(pid=19950) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19950)] FAIL: rrc_idle_mt_ping.py (18.2 sec) Error: srsepc(pid=19968): Process ended prematurely: srsepc(pid=19968) [trial-2368↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=19968)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19981): Process ended prematurely: osmo-stp_10.42.42.5(pid=19981) [trial-2368↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=19999): Process ended prematurely: osmo-stp_10.42.42.5(pid=19999) [trial-2368↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19999)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=20213): Process ended prematurely: osmo-stp_10.42.42.5(pid=20213) [trial-2368↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2368↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20577): Process ended prematurely: osmo-stp_10.42.42.5(pid=20577) [trial-2368↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20577)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20591): Process ended prematurely: osmo-stp_10.42.42.5(pid=20591) [trial-2368↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20591)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20605): Process ended prematurely: osmo-stp_10.42.42.5(pid=20605) [trial-2368↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20605)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20619): Process ended prematurely: osmo-stp_10.42.42.5(pid=20619) [trial-2368↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20633): Process ended prematurely: osmo-stp_10.42.42.5(pid=20633) [trial-2368↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20633)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20647): Process ended prematurely: osmo-stp_10.42.42.5(pid=20647) [trial-2368↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20647)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20661): Process ended prematurely: osmo-stp_10.42.42.5(pid=20661) [trial-2368↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20661)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20676): Process ended prematurely: osmo-stp_10.42.42.5(pid=20676) [trial-2368↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20676)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20690): Process ended prematurely: osmo-stp_10.42.42.5(pid=20690) [trial-2368↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20690)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20704): Process ended prematurely: osmo-stp_10.42.42.5(pid=20704) [trial-2368↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20704)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20719): Process ended prematurely: osmo-stp_10.42.42.5(pid=20719) [trial-2368↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20719)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=20733): Process ended prematurely: osmo-stp_10.42.42.5(pid=20733) [trial-2368↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20733)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20747): Process ended prematurely: osmo-stp_10.42.42.5(pid=20747) [trial-2368↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20747)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20761): Process ended prematurely: osmo-stp_10.42.42.5(pid=20761) [trial-2368↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20761)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20775): Process ended prematurely: osmo-stp_10.42.42.5(pid=20775) [trial-2368↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20775)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20790): Process ended prematurely: osmo-stp_10.42.42.5(pid=20790) [trial-2368↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20790)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20804): Process ended prematurely: osmo-stp_10.42.42.5(pid=20804) [trial-2368↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20804)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20819): Process ended prematurely: osmo-stp_10.42.42.5(pid=20819) [trial-2368↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20833): Process ended prematurely: osmo-stp_10.42.42.5(pid=20833) [trial-2368↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20833)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20847): Process ended prematurely: osmo-stp_10.42.42.5(pid=20847) [trial-2368↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20847)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20861): Process ended prematurely: osmo-stp_10.42.42.5(pid=20861) [trial-2368↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20861)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20875): Process ended prematurely: osmo-stp_10.42.42.5(pid=20875) [trial-2368↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20875)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20889): Process ended prematurely: osmo-stp_10.42.42.5(pid=20889) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20889)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20920): Process ended prematurely: osmo-stp_10.42.42.5(pid=20920) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20920)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=20934): Process ended prematurely: osmo-stp_10.42.42.5(pid=20934) [trial-2368↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20934)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20948): Process ended prematurely: osmo-stp_10.42.42.5(pid=20948) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20948)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20962): Process ended prematurely: osmo-stp_10.42.42.5(pid=20962) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20962)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20976): Process ended prematurely: osmo-stp_10.42.42.5(pid=20976) [trial-2368↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20976)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2368↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21004): Process ended prematurely: osmo-stp_10.42.42.5(pid=21004) [trial-2368↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21004)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2368↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] + rm -rf trial-2368/inst + cd trial-2368 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 02:06:58 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368-run.tgz run.2022-12-10_02-07-09 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2368-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17656.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2952.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29266.tgz osmo-nitb.build-12969.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30043.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE